Just a week ago with Montgomery at the helm, the Red Devils passed for 342 yards and four touchdowns in a 36-14 win over Grandview in their season opener.
With Montgomery unable to start against the Lancers do to an injury, Chaffee managed only 83 yards through the air and 222 overall as the Lancers pulled out a double overtime win.
"We threw for 342 yards last week with my quarterback and he ran for another 60," Red Devils' head coach Charlie Vickery said of last week's contest. "But that's no excuse, we just didn't play as well tonight. We (knew) what was coming on that last play right when they scored the (last) touchdown.
"We still had opportunities, we just couldn't get anything going. It's not good weather for a shotgun offense, obviously."
Holding an 8-2 lead late in the fourth quarter thanks to pair of first half special team plays, Chaffee was forced to punt with just over four minutes left in regulation.
St. Pius took over after a penalty on their own 19-yard line and slowly started to push in to Red Devil territory.
Almost three minutes had expired before the Lancers could push past midfield and, after a sack on the Red Devils 42-yard line, St. Pius was forced to burn their final timeout.
Whatever was decided during the break changed the Lancers fortunes as on the next play senior Talon Cook ran the ball up the left sideline before turning toward centerfield to escape a pair of defenders near the goal line.
By the end of his run, Cook has went 42 yards to tie the game at 8-8 with 1:02 left in regulation.
"We had a kid who had played offense for us pretty much the last couple of years," St. Pius head coach Jerry Woods said of Cook. "He got a little dinged up so he was only playing defense.
"His legs were fresh for that drive and he was ready to roll. We threw him out there, ran a couple inside reverses with him. It worked great."
Though an extra point would have effectively sealed their fate, the Red Devils blocked the point-after attempt to send the game into overtime.
While the Lancers turned to Cook late in the fourth, they relied on junior Chris Filer to do the heavy lifting in overtime.
After both teams went scoreless in their first series, St. Pius started the second overtime with a couple short plays before Filer broke off a 13-yard run up the middle to the 5-yard line.
On the next play, the Lancers once again handed off to Filer, who barreled up the middle and into the end zone for the go-ahead score. Staying with what was working, Filer got the ball again on the two-point conversion and put his team up 16-8.
"I think they wore us down a little bit," Vickery said. "We're not very deep at all and they wore us down a little.
"Our defense played well most of the night. Can't fault their effort at all."
With one last chance to match, Chaffee quarterback Jimmy Golden connected with Devon Yahn early in the drive for 14 yards, but the Red Devils soon found themselves facing 3rd-and-11.
Sending a pass to the left corner of the end zone, Chaffee's fate was sealed when freshman cornerback Tryson Thorton plucked the ball out of the air to seal his team's win.
With Chaffee's offense unable to find the end zone against the Lancers, the Red Devils relied on their special teams to put the Lancers in an early hole.
Forced to punt on their opening drive, St. Pius saw Chaffee junior Travis Hall grab the kick on a hop and take off down the right sideline.
Hall sprinted 60 yards and past the goal line to give his team a 6-0 advantage just two minutes into the game.
Though a bad snap botched the extra point, the Red Devils found themselves ahead 8-0 going into the half when they blocked a Lancer punt in the end zone with 3:09 left in the second quarter.
Equally as stifled offensively, St. Pius didn't put their first points on the board until a snap on a Red Devil punt late in third quarter sailed over the punters head and out the back of the end zone for a safety.
C -- Travis Hall 60 punt return (kick failed), 10:01
C -- Safety, 3:09
S -- Safety, 1:21
S -- Talon Cook 42 run (kick failed), 1:02
S -- Chris Filer 5 run (run good)
Rushing -- St. Pius -- Lance Ervin 7-13, Chris Filer 18-104, Tryson Thorton 1-4, Mickey Karoly 8-45, Brendan Withrow 1-7, Talon Cook 5-71. Chaffee -- Jimmy Golden 28-75, Charlie Montgomery 3-12, Layton Tinkhoff 2-42, Devon Yahn 1-2, Cole Hanna 1-5, Thomas Robbins 1-3.
Passing -- St. Pius -- Mickey Karoly 7-20-61. Chaffee -- Jimmy Golden 8-19-83.
Receiving -- St. Pius -- Isaiah Hennessey 3-18, Tryson Thorton 4-43. Chaffee -- Devon Yahn 5-46, Layton Tinkhoff 3-37.