Are they conspiring against you because of something you have done?
Yes.
It might be because you're not pulling your weight at work, or they think you're taking liberties with breaks or late, liquid lunches.
No. It's because the boss gave me a special project to do.
Take a look at yourself and make sure there is nothing you would change, before you take it up with the management (or wear their cats as shoes).
I think taking it to the boss will cause more trouble
This might all stem from you feeling bored at work or frustrated. You might want to inject passion and life back into your work - even something as small as a new tie or 'crazy' socks can spark something deep inside - just make sure not to quit.
As Camus said "Without work, all life goes rotten. But when work is soulless, life stifles and dies."