The Swansea-based region edged to a 16-15 victory over Pro12 basement boys Zebre on Friday night.
They face a make or break Heineken Cup clash with Leicester Tigers on Sunday and Wales’ triple Grand Slamming prop admits the Ospreys must drastically improve.
“It’s obviously a big step up against Leicester. As a pack, we’ve got to raise our game,” said Jones.
“We’ve been pretty good recently. We were good against Toulouse and we know when we’re up there we can match anyone.
“We’re going to get stuffed if we turn up like we did on Friday.
“But at least we got a win against Zebre. We were rubbish to be honest with you. I think when we’ve been good recently we’ve been doing everything simply, but we got caught trying to play in the wrong areas.
“It was frustrating because we know it’s going to be ten times harder next week.”
The Ospreys and Leicester have developed a heated rivalry over recent years and Jones expects another fiery encounter at the Liberty Stadium.
“I don’t really know how it came about,” added Jones.
“We haven’t been a region that long but I think it was when we played them in 2005 — it was one hell of a game (Leicester won 17-15 at the Liberty).
“I think (Dan) Hipkiss scored in the last minute.
“There’s no love lost. We know what a good side they are. We were disappointed with our last ten minutes when we lost up at Welford Road this season.
“You’ve got to raise your game. It’s one hell of a side, with a hell of a forward pack.
“Anyone who can bring on (Argentina prop Marcos) Ayerza and Castro (Italy prop Martin Castrogiovanni) is going to be a challenge.”
