Workers are specific to their contraption (building), which means you can't put a Mill worker in the Dairy, or a Bakery worker in the Pasture, etc.
The only workers you can put in the Pasture are cows (and Doobicorn!), and they'll show up at the Bus Stop just like the other workers!
Look at the icon on the worker's info screen -- It shows which contraption (Dairy, Mill, Bakery, or Pasture) they can go in, and lets you know if putting them in that contraption will increase (green arrow up) or decrease (red arrow down) the experience you earn from making products there.
Everything you need to know about getting new workers can be found here: How do I get (more) WORKERS?
Still have questions? Feel free to check out a few more articles, or get in touch with us!