Services & ResourcesWolfram ForumsMathGroup Archive

[Date Index] [Thread Index] [Author Index]

Eliminate duplicates using Union [] in a

• To: mathgroup at smc.vnet.net
• Subject: [mg48063] Eliminate duplicates using Union [] in a
• From: Mark Coleman <mark at markscoleman.com>
• Date: Mon, 10 May 2004 06:51:18 -0400 (EDT)
• Sender: owner-wri-mathgroup at wolfram.com

I know that if one applies the Union command to a list of values, it 
will return the list with duplicates removed. Can I use the Union 
command to eliminate duplicate when I have a list of data "records"? 
Specifically, I have a large data set that I read into a list on a 
row-oriented basis. Each element of the list consists of another list 
of about 30 different fields. Two of these fields are geographic 
indicators. If two or more records have identical values in these two 
fields, then the full records are considered duplicates and need to be 
identified and removed from the larger list (or at least marked for 
removal). Can Union do this?

Thanks,

-Mark

• Follow-Ups:
  • Re: Eliminate duplicates using Union [] in a
    • From: Tomas Garza <tgarza01@prodigy.net.mx>
  • Re: Eliminate duplicates using Union [] in a
    • From: Andrzej Kozlowski <akoz@mimuw.edu.pl>