To display invoices and other documents (as well as pages such as payment page, client panel page) in selected language by default, go to Settings> Company / department, edit the selected company department and in Documents field select Default invoice and document language (department language)

As you can see in the attached screenshot, you can also select a separate invoice template for the selected department.