The CLI Notes
Modifications to Price Search
November 23rd, 2008I have just deployed some changes to the price search which should speed up the search process a bit. You will also notice that the average prices are significantly more accurate because I have increased the sample size to include the entire faceted result (what is used on the graph), rather than a sampling of the graph data.
Price Search is Out!
November 9th, 2008Just finished deploying the Price Search feature. Right now the search feeds off of the Overall-sale item database. In the future I will also roll it out for the Autos database and probably add some more functionality to specify location, etc…
As of the writing of this post, only ~9% of my entire database is being used, but the sample and results still tend to be accurate (although not all long-tail searches deliver a ton of results). I will keep building the index - shoot me an email with any thoughts.
Still churning
November 2nd, 2008Just a little FYI — I am hard at work rebuilding the backend of the site to allow for some exciting features. Once deployed, we should see a major jump in usefulness of this site… Stay posted
Monthly Averages Deployed!
September 30th, 2008CLI is old enough to start showing monthly data!
I read a CNN story on tumbling housing prices, so I whipped together a little report over breakfast to reality check. I still need some better data to normalize for seasonality, but hopefully I can get something together soon.
Graybook is out
September 29th, 2008You might notice that the homepage changed to the ‘graybook’ home (Gray Book being a play on Kelley Blue Book). I personally find that data more interesting and useful than the daily price tracker, so I made the swap.
There are a number of enhancements in the queue for the Gray book, so definetely check back later.
It’s on its way…
September 22nd, 2008It has definitely been a while since the last update. I have been working on a lot lately — primarily figuring out how to scrub the data from invalid/repeat postings (as well as a bit more on the DBA front). Either way, I have reached a point where I think we are relatively close to publishing some usable data. Either tomorrow or the next day, I will be ready to deploy the “Graybook”!
hopefully you find it useful
Also, I havent forgotten about updating some of those overall item prices — I have a bunch of college related stuff in the pipeline. It’s hard to figure out what types of items will have price fluctuations
Mods to Consumer Item Prices page
September 16th, 2008Last night there were a few changes made
- Many new products added. You can expect another 15 tomorrow
- Consumer Item Pages has been updated to allow for 3 products to be compared against each other. There is a funny scaling issue (zeroes out when there is no data on a particular day) — this will be addressed soon
- Top 5, Bottom 5 car markets are now clickable after not working properly due to a Craigslist update
In the near future, I would look for a big enhancement that should allow for some very useful insight when assessing the value of your goods…
Ah yes, it is about time we see the meaty data!
September 15th, 2008We have just deployed the initial iteration of the Item-level price visualizations. As it stands now, we only have the Xbox 360 prices (generating this data takes time [please keep in mind that we are analyzing over 17 million postings here...]).
There are some interesting other price curves in the queue, so you should be sure to come back to see the data. Please drop me a line if there are any specific requests for items to add to the UI.
The data rendering problem has also been fixed — you can now compare ALL states against each other!!
Lots of tweaks and fixes today
September 13th, 2008You might notice a few changes today.
- Google decided to update the visualization API, so the legend is now in a readable position
- I have updated the ticker to have more rows and be more interactive. To keep the data fresh, it now only updates for each trailing 2 days.
- The locale and state averages tables have been fixed, and data should be displaying properly.
- Weekly average graphs are in the queue, and should be up soon
- I have removed some of those hideous JpGraphs
- Built a lot of the backend for better/more interesting data to come out of the personals sections (this should be interesting…)
- Some light framework is being built for low-ticket item info.
Hello world!
September 12th, 2008Given the heavy traffic from Metafilter.com, and some other blogs, I figured it was about time for me to embed some Wordpress into this site so that I can get some feedback on the site.
I also wanted to clear up a few ambiguities:
- The jobs and personals sections (which appear to be the most popular) are long due up for a data refresh (this will be a ~30x increase in the sample size)
- A lot of the graphs need to graduate to web 2.0. This will happen soon.
- We are also sitting on a huge pile of data that has not been rendered yet (I honestly didn’t know if there was an audience), but you can expect some tasty data starting next week.
- If you would like to discuss any data, or need any 1-offs, please feel free to comment or shoot me an email
- Yes, there will soon be RSS to this section so that you can stay current
-Jesse
