Have a problem

Depends on the tea… often the herbs are too small and go through the infuser but it really depends on the quality of the tea/tea bag.

“… curious if I could possibly take the tea out of the bag and put it in an infuser so it could steep better.”

Yes, there should be no problem in doing so for straight unflavored black, green, yellow, white, or puerh teas. This will also eliminate any possibility of the bag negatively affecting the flavor of the tea. Additionally, an infuser or brew basket provides more room for the leaves to expand and thus, produces fuller-flavored tea.

A brew basket, such as this one:
https://steepster.com/teaware/finum/29177-brewing-basket
https://steepster.com/looseTman/posts/186983
has a very fine mesh that will work with any tea and provides much more internal volume than most tradional infusers.

For some lower quality teabags this may not work as they usually contain a lot of tea dust that might be small enough to go right through the infuser. I would not try this with something like Lipton.