ECLDedUp: Creates an ECL "DEDUP" definition.

Description Examples

Description

The DEDUP function evaluates the recordset for duplicate records, as defined by the condition parameter, and returns a unique return set. This is similar to the DISTINCT statement in SQL. The recordset should be sorted, unless ALL is specified

Examples

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
  ## Not run: 
    ecl1 <- ECL$new(hostName="127.0.0.1", port="8008")
    recPerson <- ECLRecord$new(name="rec_person")
    recPerson$addField("STRING", "code")
    recPerson$addField("STRING", "firstName")
    recPerson$addField("STRING", "lastName")
    recPerson$addField("STRING", "address")
    recPerson$addField("STRING", "stateCode")
    recPerson$addField("STRING", "city")
    recPerson$addField("STRING", "zip")
    ecl1$add(recPerson)
    
    dsPerson <- ECLDataset$new(name="ds_person", datasetType = recPerson, 
                  logicalFileName ="~ds::person", fileType="CSV")
    ecl1$add(dsPerson)
    
    recPersonTable <- ECLRecord$new(name="personNewTableFormat")
    recPersonTable$addField(dsPerson$getName(), "code", seperator=".")
    recPersonTable$addField(dsPerson$getName(), "firstName", seperator=".")
    recPersonTable$addField(dsPerson$getName(), "lastName", seperator=".")
    
    ecl1$add(recPersonTable)
    
    tblPerson <- ECLTable$new(name="PersonNewTable", 
                  inDataset = dsPerson, format= recPersonTable)
    ecl1$add(tblPerson)
    
    PersonNewTableSorted <- ECLSort$new(name="PersonNewTableSorted", 
                              inDataset = tblPerson)
    PersonNewTableSorted$addField("lastName")
    ecl1$add(PersonNewTableSorted)
    
    mySets <- ECLDedUp$new(name="mySets", 
                    inDataset = PersonNewTableSorted)
    mySets$addField("lastName")
    ecl1$add(mySets)
    ecl1$print()
  
## End(Not run)

Example output

Loading required package: RCurl
Loading required package: bitops
Loading required package: XML
[1] " rec_person  := RECORD   STRING  code ; STRING  firstName ; STRING  lastName ; STRING  address ; STRING  stateCode ; STRING  city ; STRING  zip ;  END; ds_person  := DATASET(' ~ds::person ', rec_person , CSV ); personNewTableFormat  := RECORD   ds_person . code ; ds_person . firstName ; ds_person . lastName ;  END; PersonNewTable  := TABLE(  ds_person , personNewTableFormat  ); PersonNewTableSorted  := SORT(  PersonNewTable ,  lastName  ); mySets  := DEDUP(  PersonNewTableSorted ,  lastName  );"

rHpcc documentation built on May 2, 2019, 11:04 a.m.

Related to ECLDedUp in rHpcc...