Adjoints and formal adjoints of matrices of unbounded operators