Zach's image Rank 31st
Posts 292
Thanks 64
Joined 2 Mar '11 Email user

Is kaggle planning to submit some benchmark entries, as has been done in other competitions?  Elsewhere in the forums is discussion of a zero benchmark, a 15 benchmark, and a constant-value benchmark.

Personally, I think Jeremy Howard's best shot at this competition would be an excellent benchmark, and since he works for kaggle he could eventually release his code for all of our benefit.

 
Jeremy Howard (Kaggle)'s image Posts 166
Thanks 58
Joined 13 Oct '10 Email user
From Kaggle
I'm planning to release some tutorials over the coming months on developing models using the HPN data. I will submit the models I come up with when developing these tutorials. So that will give you a good feeling for what is required to get particular results. I'm hoping to have the first of these available a few weeks after the remaining data is released.
Thanked by Cyfarwyddyd , Zach , B Yang , Gary , and cnie
 
Zach's image Rank 31st
Posts 292
Thanks 64
Joined 2 Mar '11 Email user
Awesome!
 
Karan Sarao's image Posts 52
Thanks 2
Joined 14 Mar '11 Email user
I would like to know whats the current RMSLE score HPN has on its own algorithms. i.e. like Netflix published their score, that is if HPN already has some analytics running on this data.
 
Anthony Goldbloom (Kaggle)'s image
Anthony Goldbloom (Kaggle)
Competition Admin
Kaggle Admin
Posts 382
Thanks 72
Joined 20 Jan '10 Email user
From Kaggle

We can't give you an HPN benchmark because they've not tackled this problem before. 

 
Karan Sarao's image Posts 52
Thanks 2
Joined 14 Mar '11 Email user
Out of curiosity then how did the benchmark become .4 , why pull .4 out of the box?
 
Information Man's image Posts 14
Thanks 1
Joined 8 Apr '11 Email user

Karan Sarao wrote:

Out of curiosity then how did the benchmark become .4 , why pull .4 out of the box?

Because they want to spend 500k rather than 3m?
Thanked by Domcastro
 
Domcastro's image Posts 70
Thanks 15
Joined 8 Aug '10 Email user

Information Man wrote:

Karan Sarao wrote:

Out of curiosity then how did the benchmark become .4 , why pull .4 out of the box?

Because they want to spend 500k rather than 3m?

My Thanks was more of a Facebook Like as it made me laugh!

 

 
Sarkis's image Posts 41
Thanks 5
Joined 5 Apr '11 Email user

Jeremy Howard (Kaggle) wrote:

I'm planning to release some tutorials over the coming months on developing models using the HPN data. I will submit the models I come up with when developing these tutorials. So that will give you a good feeling for what is required to get particular results. I'm hoping to have the first of these available a few weeks after the remaining data is released.

This would be very much appreciated. I'm now watching An Introduction to Medicare Claims Public Use Files and it would be nice to have a couple of (hypothetical) examples that would show how entries for HHP_release were created.

Thank you very much!

 

 

Reply

Flag alert Flagging is a way of notifying administrators that this message contents inappropriate or abusive content. Are you sure this forum post qualifies?