It won't be necessary, because when you use pfctl to load a table from a file, duplicates addresses will be ignored.
If you are still concerned, use your Internet search tool to find "shell script to remove duplicate lines in a file" and you'll get a list of methods to choose from, such as
these.