Epistemic Status: I thought of this yesterday and it seems plausible, but my initial attempts couldn't get it to work (as best as I could tell) and I don't have more time to commit to this. Anyone can feel free to try it, no need to credit me if it works, I just want to see this happen. Here's a technique you could use to get a steering vector that represents any text dataset (say, that represents the author of that text). It's using the idea in this paper but for activation steering instead of RL.