How to remove duplicate entries from a file using Ansible

Question

Hi Guys,

I have one file in Ansible node. I want to remove the duplicate entries from this file and upload the file in the remote systems using Ansible Playbook. How can I do that?

Answer 1

Hi@akhtar,

You can use the shell module to do your task. But shell module doesn't have the capability to remove duplicate entries. You need to do some tricks as shown below.

 - name: Find uniqe entries
   shell: cat Mergedfile | sort -u | uniq -u > hosts