The patrol vessels have, next to their policing tasks, the important military role of naval intelligence gathering. In this research project we investigate the possibility of expanding this role by automating the fusion of electro optical imagery data with human intelligence, to generate reports on ship identity, signature and activity.