Services & Resources / Wolfram Forums
-----
 /
MathGroup Archive
2007
*January
*February
*March
*April
*May
*June
*July
*August
*September
*October
*Archive Index
*Ask about this page
*Print this page
*Give us feedback
*Sign up for the Wolfram Insider

MathGroup Archive 2007

[Date Index] [Thread Index] [Author Index]

Search the Archive

Re: grouping similar list elements with gaps

  • To: mathgroup at smc.vnet.net
  • Subject: [mg73481] Re: [mg73468] grouping similar list elements with gaps
  • From: Stern <nycstern at gmail.com>
  • Date: Mon, 19 Feb 2007 01:29:49 -0500 (EST)
  • References: <200702181113.GAA13453@smc.vnet.net>

At any given time, I care only about the data above the threshold, or
only about the data below the threshold. There is nothing fuzzy about
that -- if I'm studying the periods where the variable is over 5, then
5.00001 counts just as 500 does. What I am trying to capture in my
original question is the situation where there is a period over 5,
then a gap of one or two time units when it slips below 5, then a
period above 5 again.

Thanks for any advice,

Michael

On 2/18/07, Chris Chiasson <chris at chiasson.name> wrote:
> how "far above or below" the threshold are you willing to go?
>
> On 2/18/07, Stern <nycstern at gmail.com> wrote:
> > I work with time series data of the form
> > {{timecode1,datum1},{timecode2,datum2},...}. The timecodes can be in
> > any of several formats, but for internal calculations I convert them
> > to "Mathematica integer" format, which is to say, the absolute number
> > of seconds since the beginning of January 1, 1900.
> >
> > My current interest involves continuous runs of dates above or below a
> > defined threshold. This is relatively easy, using the Split and Select
> > commands. For example,
> >
> > Select[Split[TIMESERIESLIST, Sign[#1[[2]] - THRESHOLD] ==
> >     Sign[#2[[2]] - THRESHOLD] &], (Min[Transpose[#][[2]]] =98 THRESHOLD
) &]
> >
> > (Thanks to Bob Hanlon, for suggesting this basic approach).
> >
> > I would like to generalize this to handle cases where there are small
> > gaps in the pattern. So, for example, if I am willing to tolerate a
> > gap of 3, then if list members 3-100 are above the threshold and list
> > members 102-200 are above the threshold, then the entire period 3-200
> > is marked as above, though time unit 101 would, on its own, fail.
> >
> > This may need to be handled recursively, as combined periods above the
> > threshold may fall close enough together that they should be combined
> > in turn.
> >
> > I have thought of some relatively inelegant ways of handling this
> > ("preprocessing" the time series to create a dummy list in which gaps
> > have been adjusted over the threshold), but I feel as though there
> > ought to be a better way to handle it.
> >
> > Thanks in advance for any help,
> >
> > Michael
> >
> >
>
>
> --
> http://chris.chiasson.name/
>


  • Prev by Date: Re: explanation need!
  • Next by Date: Re: explanation need!
  • Previous by thread: Re: grouping similar list elements with gaps
  • Next by thread: Re: grouping similar list elements with gaps