Is it possible to set reply to and from address when sending email?

We have a use case where we have a unique id, e.g. 12345, for each customer case and we want to have a unique email address with that id, e.g. 12345@cases.example.com, that a customer can send emails to when they have queries. We have setup the inbound flow so customers can send us emails to the unique email address and we can see them in the Front inbox, however, we can’t seem to be able to specify we are replying from that unique email address or set the reply to header to be that unique email address. This breaks our workflow. Is there any way around this?