Edit the file at /etc/unbound/unbound_srv.conf and add one line per host:
/etc/unbound/unbound_srv.conf
local-data: "myserver.local IN A 192.168.0.4"