In Linux shell scripting if we want remove dupicate line, how can i do that except sort -u command

Question

write a script name to read file name from the end user and remove duplicate line from in that file.

#! /bin/bash read -p "Enter any file name to remove duplicate line:" $fname sort -u $fname > tmp.txt mv tmp.txt > $fname

here duplicate line will be remove but my content will be sorted but i don't that what should i do.

i want another method to remove duplicate line in shell scripting.

`cat -n file.in | sort -k2 -u -s | sort -n | cut -f 2- > file.out` — jhnc, Dec 29 '22 at 19:01

score -2 · Answer 1 · answered Dec 29 '22 at 18:34

-2

You can remove duplicate lines by the 'uniq' command.

answered Dec 29 '22 at 18:34

Aitijhya Sarkar

1

`uniq` only works on **sorted** data, which they explicitly **didn't** want. – tink Dec 29 '22 at 18:45