God it took me a long time to find this again …

If you want to you can disable tabs from the command line. Make sure TextMate isn’t running, and then type:

defaults write com.macromates.textmate OakProjectWindowShowTabBarEnabled false

into the terminal. To bring tabs back, you’ll have to:

defaults delete com.macromates.textmate OakProjectWindowShowTabBarEnabled