It’s not that people don’t care, it’s that if he is killing you in pvp zones like ms, he is playing the game. Some players like to farm, some like to uw, some like pvp.
Try talking to him to fix the problem. If talking doesn’t work, train heavy/mace/sb/assassin and enchant your gears so you can defend yourself in pvp.
If he is harassing you by making fires, avoid dallying at Crossroads. Mine obsidian and collect feathers, then make a base in gale. When he tries to harass you in gale, you can fight him next to your base protected by your towers.
I don’t go to pvp zones when pvp players are online either.