Services & Resources / Wolfram Forums / MathGroup Archive
-----

MathGroup Archive 2010

[Date Index] [Thread Index] [Author Index]

Search the Archive

Re: Need to align data from sublists to Union of dates

  • To: mathgroup at smc.vnet.net
  • Subject: [mg111264] Re: Need to align data from sublists to Union of dates
  • From: Robert McHugh <r62m10 at gmail.com>
  • Date: Sun, 25 Jul 2010 02:23:17 -0400 (EDT)

Below are some thoughts about how to address this questions.
After finding the union of all times (which you did in the question),
then find the position of those times in the sublists.
then lookup the values corresponding to those positions.
Finally, combine the results.


(*This simulates the data format your described,with 3 data sets,each \
dataset containing a real value and a time value.Times are \
represented as an integer.*)

nPoints = 7;

timeA = RandomSample[Range[15], nPoints];
valueA = RandomReal[{1, 5}, nPoints];
listA = Partition[Riffle[valueA, timeA], 2];
listA // MatrixForm

timeB = RandomSample[Range[15], nPoints];
valueB = RandomReal[{1, 5}, nPoints];
listB = Partition[Riffle[valueB, timeB], 2];
listB // MatrixForm

timeC = RandomSample[Range[15], nPoints];
valueC = RandomReal[{1, 5}, nPoints];
listC = Partition[Riffle[valueC, timeC], 2];
listC // MatrixForm

myList = {listA, listB, listC};


(*============================================================*)
(*Below processes the data as described.*)
(*This is the union of all times found in the above data set*)

allTimes = Union @@ myList[[All, All, 2]];
nTimes = Length[allTimes];

(*Find the times for each list*)

myTimeA = myList[[1, All, 2]];
myTimeB = myList[[2, All, 2]];
myTimeC = myList[[3, All, 2]];

(*Find the position of the times for each data set*)

myPosA = Position[myTimeA, #] & /@ allTimes;
myPosB = Position[myTimeB, #] & /@ allTimes;
myPosC = Position[myTimeC, #] & /@ allTimes;

(*For each data set,get the value corresponding to the postion found \
above *)
(*or report-1 if time is not present in the dataset for each time*)
(*or report-2 if multiple values were found in the dataset for a \
single time*)

myValsA = myList[[1, All, 1]];
partA = If[Length@# == 1, Part[myValsA, #[[1, 1]]],
     If[Length@# == 0, -1, -2]] & /@ myPosA;

myValsB = myList[[2, All, 1]];
partB = If[Length@# == 1, Part[myValsB, #[[1, 1]]],
     If[Length@# == 0, -1, -2]] & /@ myPosB;

myValsC = myList[[3, All, 1]];
partC = If[Length@# == 1, Part[myValsB, #[[1, 1]]],
     If[Length@# == 0, -1, -2]] & /@ myPosC;

(*Combine the dataSets*)
result = Partition[Join[allTimes, partA, partB, partC], nTimes] //
   Transpose;
result // TableForm

Best Regards,
Robert McHugh

========================================================

Hi everyone,

A simple example of my problem follows.

I have a nested list, myList, with the following dimensions:

     Dimensions[#] & /@ myList

     {{93, 2}, {93, 2}, {93, 2}, {88, 2}, {92, 2}, {93, 2}, {93, 2}}

The columns of each sublist contain values and SQLDateTime(s)
respectively, i.e:

     myList[[1,1]
=E2=80=A8      {1.01055, SQLDateTime[{2010, 7, 9, 10, 30, 0.}]

I've sorted each sublist by SQLDateTime.

The Union of the date columns across all sub lists give me 120
distinct dates.

     myUnion = Union @@ (myList[[All, All, 2]]);
     Length[myUnion]

     120

That's what I have so far.

Now I need to do 2 things:

First, create a 2 dimensional list with dimensions {120, 7} that would
have myUnion as the first column and the seven columns of values from
the sublists in myList aligned with their respective dates in
myUnion.  This will leave me with some blanks throughout the matrix
which I need to fill in with the value 1.

Just not sure how to do it.

Please advise.

Many thanks


  • Prev by Date: Re: Experimental Data Analyst
  • Next by Date: Re: de-nesting complex nested lists
  • Previous by thread: Prediction Bands and Confidence Intervals
  • Next by thread: Re: Need to align data from sublists to Union of dates