Amity is ridiculous. Just wave.

If you use potions and keep trying, eventually he will be around 36-40 interest, so you can get around 50-80 amity per game. I did that until the cost to talk was 10 energy, when it was around 700 amity, then the rest was using F5. I spent ~200 energy to get 750 amity.

Try this:
Defence Trench
Helm Small Mace
Helm Iron Shield
Golem Summoning stone (or Helm Tribe Mineral Wagon)

This works best for me (level 5 Altinova)
Defense Trench
Helm Tribe Mine
Helm Tribe Forge
Wilderness Golem

1.Helm Tribe Mine
2.Stone Golem
3.Wilderness Golem
4.Helm Iron Shield
If you spend more energy than gaining amity, start waving.