They're complaining about their lives on the plantation
The man has been working many long hours in the hot blazing sun, while the woman has to deal with the wife of the master because she suspects some lies between their relationship.
They are miserable. They're at the bottom of the Southern food chain, and life really couldn't get worse. Despite the fact that they need their masters to survive since they supply them with basic needs, it makes life hard when you're forced to work for someone else for no pay for your life.
This is a young yeoman talking with some members of the Planter Artistocracy during a dinner party.
The aristocrats are the top of the Southern food chain. They have the most slaves and make a lot of money, granting them a life of luxury. The yeoman, on the other hand, is a middle class worker who gets by with maybe one or two slaves and aren't nearly as successful. Despite this, they aren't upset because they depend on the aristocrats to keep the business alive, just like how the slaves depend on the masters to supply them with their basic needs and the yeomen are relied on to keep the ratios even.
Pre-Civil War Southern America was a very detailed, yet controversial system of business that many historians question. Regardless, thses practices remained and continued to haunt the American way for many decades.