Pros
Good benefits (which start the month you begin), IRA (retirement, not 401k), access to Caltech facilities like gym, recording studio, credit union, etc. Decent vacation time (starts at almost 3 weeks per year, after 5 years goes up, after 10 years goes to nearly one month per year. Some departments still use the honor code, and don't look over your shoulder as you work. Many other departments were reformatted with corporate influence. They brought people in from the corporate world to see how they could save money during the 08/09 deprecession (yes, I wrote deprecession, because it lasted too long to be a recession, but not long enough to be a depression).
Cons
The pay is abysmal. This is the trade off for being at the top of your field. Caltech is the best school in the world to study science, and working there is a great opportunity and resume builder. They just pay next to nothing, because they know that the people working there are there for the job, not the money. After they brought in the corporate consultants (people from the corporate world to tell them how to save money), they threw the honor code out the window for staff (it still applies to professors and students). Prior to this, you could take a two hour lunch and go to the gym (for free), park for free, and make up time when you didn't work your full 8 hours. That all went away, as now you have to clock in and out using Kronos, they are sticklers for the rules (you have to take your lunch before the five hour mark or you get written up). The lab I worked in had an incredible vibe when I first started working there, where everyone enjoyed their job, was excited to be a part of Caltech, and couldn't say a bad thing about working there. Once they had the corporate consultants come in (after the deprecession), the whole ,morale of the department tanked once this happened.