Pros
Easy job to get; if you meet the requirements, you're in. You can work from home and the pay is okay, although insulting for a job that requires a college degree. Incentives for being both fast and accurate.
Cons
This is the worst micromanagement I have ever seen in my life. You are nothing more than a warm body to them; easily replaced when you burn out due to the mind-numbing nature of the work and the lack of trust and support. If you don't meet a certain speed and accuracy level, you are tersely informed of your inadequacy, via either chat or phone (yes, they will call you and chastise you for being too slow, too inaccurate, etc.), during your shift. There is absolutely no independent thought allowed in this position; if you do not follow the rubric EXACTLY and if your ratings don't match up precisely with those assigned by the more senior scorers, you are forced to retrain (on THEIR schedule, mind you, not yours), and if you're still not perfect, you're fired. I don't know why they hired us if they didn't intend to trust our word. This job requires a bachelor's degree, but like I said, they don't trust you or your education. You are connected to a scoring supervisor for your entire shift and your performance is monitored constantly by an indicator on the screen. This level of micromanagement is not only extremely stressful, it is counterproductive; it's difficult to concentrate and even more difficult to perform well when one is constantly anxious about being chastised for "low validity/performance" at any given moment. Ironically, if we were given more freedom and flexibility, I can almost guarantee performance and morale would skyrocket. Besides the toxic micromanagement, the work itself is, as I mentioned, mind-numbing to the extreme. The essays are generally poorly written, and you're required to stare at them for hours on end, which is unbelievably dull. You can almost feel your performance slipping the longer you do it, which will, of course, prompt a snarky phone call or message. I've been doing this off and on for a year, and not only has it not gotten better, it has gotten worse. You aren't expected to use your education, your skills, or your experience. You are expected to read the mind of a different random stranger for every shift.