Back to proposals

Compassion based persona misalignment

commitment
5 hrs/week
flexibility
No mentee proposal
mentored by
Declan McKenna
Declan McKennaSentient Futures Resident

The project

Does compassion for animals fade before compassion for humans when fine-tuning misaligned models?

Using an emergent misalignment fine-tuning protocol on an open source model we would force it to become misaligned in a similar manner to the misanthropic models fine-tuned on poor code. We'll save frequent checkpoints during the fine-tuning process and measure the models scores on Animal welfare, capability and human welfare benchmarks. We can also examine the internals of the model to track welfare & capability declines.

We'll also test out if welfare trained models lose their compassion for humans and non-humans at the same rate to validate if their compassion is robust.

I'm 75% sure I'll take on this project. It's possible I may take on a benchmarking project instead.

The mentee's role

Not sure yet. I've a technical background but not much of a research background, so someone who can help me out with the research side of things would be invaluable.

Who I'm looking for

Must-have:

  • Good communication

Nice-to-have:

  • Research experience
  • ML Experience
  • Coding experience (very mild nice to have as I can cover this)

Questions for applicants

  1. What are your thoughts about this project?
  2. What would you like to accomplish while doing this project?
  3. Why is this project a good fit for you?

Support offered

  • Career advice
  • Connections
  • Utilising agentic tools
  • Coding and project management know-how
format
Research & writing
topic
Near-term impact · Post-AGI transition · Neglected animal groups · Macrostrategy
Declan McKenna

Declan McKenna

Sentient Futures Resident

I’m a nomadic Software Engineer who specializes in iOS Engineering, Framework development, Automated testing, and Architectural design.
I will be leading my first independent research project during the incubator.

  • 6 years as a professional poker player (only 2 years fulltime)
  • 10.5 years as an iOS Framework Engineer
  • 1.5 years as a Data Engineer working and organizing projects for Tumblr’s image classifier
  • 1 year upskilling in AISafety and taking on voluntary research projects.