Leaders in the remote Northern Territory community of Wadeye say they hold "grave concerns" for people's safety amid ongoing clan violence and fear it is only a matter of time before someone is killed.