Working on Getting the Botball Live Archives YouTubed

8 replies [Last post]
Jeremy Rand
Jeremy Rand's picture
Title: Botball Youth Advisory Council
Joined: 04/03/2009
Posts:
BotPoints: 1168
User offline. Last seen 2 years 30 weeks ago.

Hey everyone,

I know several of you are waiting for the Botball Live GCER webcast to be posted on YouTube. It's been delayed due to Ustream damaging some of the videos. Some videos are perfectly intact, others have damage that appears fixable (with work), and a few might be damaged beyond repair. I'm slowly working through them to make sure that everything that we post to YouTube actually works properly.

I'm also rigging up some automatic way to tag the videos, since I really don't want to have to manually enter data for 300+ matches. Luckily the data is in machine-readable format thanks to our Twitter bot, it just needs some reformatting.

I'll post here when I have an update... hopefully it won't take too long. (You guys are so lucky I'm unemployed and therefore have lots of free time for now... the sacrifices I make for you guys....)

However, here's a question. I know some of you would like to have copies of your matches on a more permanent medium than YouTube... would you be interested in a torrent of all the GCER videos? (Most modern BitTorrent clients will let you choose which files you want, so you wouldn't have to download all the videos.) If there's interest in a torrent, I'll investigate that option. (It'll still go on YouTube regardless.)

-Jeremy Rand
YAC President

-Jeremy Rand
Senior Programmer, Team SNARC (2012-2013), Norman Advanced (2010-2011), Norman HS (2008-2009), Norman North (2005-2007), Whittier MS (2003-2004)
2012-2013 VP of Tech, 2011 President, Botball YAC (2009-2013)
Mentor, Alcott and Whittier MS

PiPeep
PiPeep's picture
Title: RocketBot
Joined: 07/19/2009
Posts:
BotPoints: 170
User offline. Last seen 3 years 39 weeks ago.

I think a torrent would be great, and I'll seed it, at least until I move off to college in a month or so, where I may or may not be able to get around their P2P filters.

Jeremy Rand
Jeremy Rand's picture
Title: Botball Youth Advisory Council
Joined: 04/03/2009
Posts:
BotPoints: 1168
User offline. Last seen 2 years 30 weeks ago.

Cool... in that case, I'll investigate making them available via torrent. Not sure exactly when that will be, but I'll try to get it done as fast as possible.

-Jeremy Rand
Senior Programmer, Team SNARC (2012-2013), Norman Advanced (2010-2011), Norman HS (2008-2009), Norman North (2005-2007), Whittier MS (2003-2004)
2012-2013 VP of Tech, 2011 President, Botball YAC (2009-2013)
Mentor, Alcott and Whittier MS

Jeremy Rand
Jeremy Rand's picture
Title: Botball Youth Advisory Council
Joined: 04/03/2009
Posts:
BotPoints: 1168
User offline. Last seen 2 years 30 weeks ago.

I'm making some progress... seems that our method of storing data in the Twitter feed isn't exactly the easiest way to get usable data. All the Twitter data is extracted for all D.E. matches; still need to do Seeding and Alliance. Some of the Ustream data is extracted as well (all D.E. matches on Tables 1 and 2), as is the Joust data for all D.E. matches.

Sorry for the delay, but this will take some time while I sort through the massive amount of data. Next season we'll have a much more reliable, hassle-free, and automated way of handling the match data. (Next year we'll also have much better video quality.)

I should mention that at least 6 D.E. matches are in some way damaged. Some may be repairable. For reference, the damaged D.E. matches which I've already found are:

11-0140 Merrimack Valley Homeschoolers 11-0325 The Peddie School
11-0006 Dead Robot Society 11-0306 American School of Doha
11-0049 Southwest Covenant School 11-0033 Palm Desert Charter Middle School
11-0210 Deming High School 11-0199 North Hollywood High School
11-0169 Oak Grove High School 11-0074 Episcopal School of Dallas
11-0140 Merrimack Valley Homeschoolers 11-0052 Hanalani Schools

There may be more damaged matches that I haven't noticed yet.

Just thought I'd give you an update here.

-Jeremy Rand
Senior Programmer, Team SNARC (2012-2013), Norman Advanced (2010-2011), Norman HS (2008-2009), Norman North (2005-2007), Whittier MS (2003-2004)
2012-2013 VP of Tech, 2011 President, Botball YAC (2009-2013)
Mentor, Alcott and Whittier MS

Jeremy Rand
Jeremy Rand's picture
Title: Botball Youth Advisory Council
Joined: 04/03/2009
Posts:
BotPoints: 1168
User offline. Last seen 2 years 30 weeks ago.

It's been a while, time for a status update. I was delayed for a month or so due to my Excel installation bricking itself, and I didn't have a disc to reinstall it. (The Botball Live data is in Excel format... and please don't suggest OpenOffice.) I'm on a new PC now, so that's resolved. Lots of progress made on getting the archives ready to post, but work is still needed. The fact that I'm now in college has not expedited the process.

YAC has also been planning Botball Live for next year... I'm not able to reveal our plans yet, but suffice to say that we will be putting a large amount of effort into making certain that the delays in getting the 2011 videos up will not recur in 2012.

The quality is surprisingly good on most of the videos (after some tinkering), but we plan to improve a lot in this area for 2012.

So, I apologize for the delays so far; we know it's not optimal, and we're working on it.

Thanks for your patience,
-Jeremy Rand
YAC President
Botball Live Project Manager

-Jeremy Rand
Senior Programmer, Team SNARC (2012-2013), Norman Advanced (2010-2011), Norman HS (2008-2009), Norman North (2005-2007), Whittier MS (2003-2004)
2012-2013 VP of Tech, 2011 President, Botball YAC (2009-2013)
Mentor, Alcott and Whittier MS

Jeremy Rand
Jeremy Rand's picture
Title: Botball Youth Advisory Council
Joined: 04/03/2009
Posts:
BotPoints: 1168
User offline. Last seen 2 years 30 weeks ago.

Also, I have discovered that Ustream is remarkably skilled at corrupting videos in ways that crashes every tool I've tried to use to repair it, including ffmpeg. I'll be contacting ffmpeg tech support soon to see if there's a way to fix the issue. The affected videos include a lot of matches, unfortunately.

Hopefully ffmpeg tech support can help me out here.

-Jeremy Rand
Senior Programmer, Team SNARC (2012-2013), Norman Advanced (2010-2011), Norman HS (2008-2009), Norman North (2005-2007), Whittier MS (2003-2004)
2012-2013 VP of Tech, 2011 President, Botball YAC (2009-2013)
Mentor, Alcott and Whittier MS

Jeremy Rand
Jeremy Rand's picture
Title: Botball Youth Advisory Council
Joined: 04/03/2009
Posts:
BotPoints: 1168
User offline. Last seen 2 years 30 weeks ago.

Looks like I won't be needing to contact ffmpeg tech support, as I've discovered that mencoder can repair the affected videos. So I'll be running mencoder on all of those videos over the next few days. Hopefully there won't be any further issues.

-Jeremy Rand
Senior Programmer, Team SNARC (2012-2013), Norman Advanced (2010-2011), Norman HS (2008-2009), Norman North (2005-2007), Whittier MS (2003-2004)
2012-2013 VP of Tech, 2011 President, Botball YAC (2009-2013)
Mentor, Alcott and Whittier MS

Jeremy Rand
Jeremy Rand's picture
Title: Botball Youth Advisory Council
Joined: 04/03/2009
Posts:
BotPoints: 1168
User offline. Last seen 2 years 30 weeks ago.

Actually the situation was more complicated than I thought... some videos can only be repaired by ffmpeg (mencoder and VLC crash), others only by mencoder (ffmpeg and VLC crash), and others only by VLC (ffmpeg and mencoder crash). Anyway, all the D.E. matches have been repaired; I don't think many matches were lost. Still some issues with automated tagging that I'm working on, but it's going smoothly. After that's dealt with, I'll do Seeding and Alliance, and the few other events that were streamed (e.g. talks), and they'll go on YouTube and a torrent.

-Jeremy Rand
Senior Programmer, Team SNARC (2012-2013), Norman Advanced (2010-2011), Norman HS (2008-2009), Norman North (2005-2007), Whittier MS (2003-2004)
2012-2013 VP of Tech, 2011 President, Botball YAC (2009-2013)
Mentor, Alcott and Whittier MS

Jeremy Rand
Jeremy Rand's picture
Title: Botball Youth Advisory Council
Joined: 04/03/2009
Posts:
BotPoints: 1168
User offline. Last seen 2 years 30 weeks ago.

Cutting the Seeding matches is in progress; I've got the metadata organized for about 25% of the Seeding matches at this point; most of the rest of the Seeding tagging is just tedious busy-work. Thanks for your patience.

-Jeremy Rand
Senior Programmer, Team SNARC (2012-2013), Norman Advanced (2010-2011), Norman HS (2008-2009), Norman North (2005-2007), Whittier MS (2003-2004)
2012-2013 VP of Tech, 2011 President, Botball YAC (2009-2013)
Mentor, Alcott and Whittier MS