One factor is that the VVT-i is "Intelligent" (the "i"). It learns how you drive and imitates that, optimizing what helps whether it is power or economy. So, if you have been puttering around, that is what it will do. Mine was initially sluggish, but will now squeel rubber and hit rev-limiter in full auto (done a BUNCH using shift-tronic so it "learned" that).
Also, the "gear" step-tronic (or whatever Toyota calls it) is really a gear limiter. What it does is tell your engine the MAX gear you want in the automatic transmission. It WILL use the gears lower than selected, it the ECU deems appropriate. That is why "default" when you move it over is "3" and not whatever it would be for your speed. They figured "3" is a good passing gear @ speed, w/o being "bad" for lower speeds. You must "pop" it down to force lower gears. Also, the ECU won't allow lower gears than minimal for your present speed, i.e. it won't LET you go to first when going 60 or second @ 80. Knowing that, it is easy to manipulate to perform like a stick.
(I can drive stick and still have my stick Miata, but got an auto so the wife can drive the xB and we have 2 she feels "comfortable" driving out of our 3. If the shifter option wasn't there, mine would have been a stick and I would have had a "less than pleased" wife . . . oh well. Compromises in life for those you love . . . . :lol: )
That might explain what's happening.
If not, then you should check filters and see if it needs to get looked at for a problem. After 40,000 miles+, my xB is still very, very peppy. Use it that way, and it will stay that way.