Thanks to a great old post on the TradingBlox Roundtable Forum (by the inimitable “Sluggo”), I will add some new tests to my data validation protocol. This post is part of a series including:

  1. Garbage In => Garbage Out
  2. Creating Good Price Series
  3. Data Validation
  4. Generalized Extreme Value Distribution

New tests

  • Low <= Open <= High
  • Low <= Close <= High
  • Intraday range within expectations (Use Extreme Value Distribution).
  • Unusual number of days without price data.
  • Final date in series matches expected value.
  • OHLC match legitimate tick values.

Old tests

  • Most recent value is “reasonable”.
  • Change in raw close on each roll-over is within expectations.
  • Daily change in raw close is within expectations (Use EVD).
  • Difference between raw close and Panama close is constant between roll-overs.

One particularly nice idea Sluggo had was to run the validation from within TradingBlox itself – I use an R script. I use a file of previous “resolutions” to save highlighting old problems and I write a new file each time as a “Quality Record”. This can be handled using Blox Basic. So, it seems that I could easily port this process into TBB!

New Commodity Pool Launches

Please provide your name and email address so we can send you our quarterly compilation of new commodity pools registered with NFA.

We hate SPAM and promise to keep your email address safe.

Thank you. Your file will be available after you confirm your subscription. Check your in-box!

Biggest Hedge Funds By $AUM

Please provide your name and email address so we can send you our quarterly compilation of biggest hedge funds by $AUM as reported on the SEC's Form ADV.

We hate SPAM and promise to keep your email address safe.

Thank you. Your file will be available after you confirm your subscription. Check your in-box!

Free Hedge Fund ODD Toolkit

Note this is US Letter size. If you want A4, use the other button!

We hate SPAM and promise to keep your email address safe.

Thank you. Your file will be available after you confirm your subscription. Check your in-box!

Free Hedge Fund ODD Toolkit

Note this is A4 size. If you want US Letter, use the other button!

We hate SPAM and promise to keep your email address safe.

Thank you. Your file will be available after you confirm your subscription. Check your in-box!

Subscribe:

Don't miss our next hedge fund article!

We hate SPAM and promise to keep your email address safe.

Thank you! Check your email for confirmation message.

Share This

Share

If you found this post informative, please share it!