Each day a person is obligated to study written Torah, which is the Tanakh, Mishnah, Gemara, and Poskim. And a Ba'al HaBayis, who only studies three or four hours a day, should not study only Gemara, since by doing so he hasn't fulfilled his obligation. Rather it is necessary that he studies specifically the works of the Poskim as well, each according to his ability. (Chayei Adam, Hilchos B'rachos u'Tefillos 10:3)
B"H Maybe one day, with work, I could be a ba'al habayis.