Football fans are about to get the ultimate view of their favorite sport.
A prototype device known as the BallCam might one day enable them to see the action from the ball's point of view, providing a different perspective when a pass sails into the hands of a receiver or a punt falls into the arms of a returner. Amazingly, it would also eliminate any confusion in the image caused by the rotation of the ball, thus giving a clean, uninterrupted view from an insider vantage point.
"It's really the right time for this," Kris Kitani, a post-doctoral fellow at Carnegie Mellon's Robotics Institute who co-developed the system, told Design News. "If you could watch a defender battling with a wide receiver and see the drama of that split-second action, it would be awesome from the spectator's point of view."
The BallCam is capable of editing out the spinning of the football and providing a usable image. (Source: Carnegie Mellon Robotics Institute)
Indeed, the BallCam would provide viewers with an experience unlike anything that's been available previously. To create that experience, Kitani worked with visiting researchers at the Robotics Institute and from the University of Electro-Communications in Tokyo. Together, they embedded a single GoPro Hero2 camera in a rubber-sheathed, plastic foam football, then wrote software to make the spinning images usable.
The software is the key, Kitani said. Because a spiraled pass from a quarterback can rotate at a surprising rate of 600 rpm, images from inside the ball would be useless without software to make sense of it all. The research team addressed that by employing techniques such as image stitching, feature extraction, and feature matching, then wrapping them together in a software package.
As a result, the BallCam is able to extract video frames that are pointing in the wrong direction, and keep those that are pointing in the correct direction. It accomplishes that by looking for the sky in every frame.
"When the camera points toward the sky, the image is really bright, and when it points down, the image is darker," Kitani told us. "So if you look at the brightness of each video frame and plot it over time, the output looks like a nice, clean sine wave."
During operation, the BallCam doesn't process the images on board. Instead, it captures 60 frames per second and then lets an off-board computer do the processing. Kitani said the team employed a MacBook Pro, but added that any notebook computer would suffice. He said the team did not write the algorithms for a parallel processing environment, but could easily do so if an application called for faster results.
To be sure, the technology faces hurdles. The camera, which is about one-third the size of an iPhone, must be covered by a clear plastic material in order to be incorporated in a football, making it impossible for it to be used officially in its current embodiment. The ability of the camera to stand up to the punishment of football is not in question, however, since the same hardware has previously been used on football helmets and spearfishing masks, as well as in the jaws of polar bears, sharks, and alligators.
For now, Kitani foresees it being employed for highlight films, training purposes, and sports science studies. It might also see use in soccer balls. "The technology is there," he said. "The cameras are durable and lightweight. You could embed multiple cameras inside a ball, transmit the images wirelessly, and create an all-new experience for spectators."
You're right, bkcTN. The technology for calling balls and strikes is available right now. Baseball is a little more stodgy about change, though. It would probably take an act of Congress to get the MLB to make that kind of change.
Another intersting thing about kickoffs, William K, is that the researchers said they would need two cameras inside the ball instead of one. Evidently, the end-over-end motion of a kickoff is too much for one camera to handle.
Can you immagine the impact from watching the kickers foot come at the ball at the kickoff, or for the extra point?Suddenly this huge foot approaches and then WHAM! Probably a few couch potato injuries from that image.
The main reason I LIKE soccer and DESPISE baseball, football, basketball is the continuous replays, standing around of the players, talking (yelling) of the coaches, measuring the lines, etc. that manage to turn a 15 minute game into a 2 hours of mind numbing boredome.
Now they will have even more things to replays (from the in-ball camera) to show us to make the game even more boring.
I can only pray that NO govt. money was spent developing this.
Well, while we are talking practical applications in unecessary events such as sports, why in the world do we not use technology to accurately and consistently call strikes in baseball? Obviously, that technology has existed for decades and hasn't been used either. And, yet we have "instant" replay in football?
And, I apologize for not getting down to the part that contained the 60 fps. I think I saw the video and the bright, shiny video caught my eye.
@bkcTN: According to the article, the capture rate is 60 fps. This would give a useable frame rate of about 15 - 30 fps. It wouldn't take too much to bring it up to 24 fps for television.
I wonder how robust the "sky-detecting" algorithm is. I'm guessing it wouldn't work very well during Bears-Packers games in the snow.
The Hero3 does 120 fps already... in 720p... a very cheap consumer level solution.
You could EASILY double or triple that framerate for a commercial application. It could probably stitch the data inside the ball in real time, and transmit LIVE for that matter... it might even calculate "tweens" on the fly and insert that into the datastream.
A new book by Thomas Edison's great-grandniece takes on the notion that he was a lone-wolf inventor and replaces it with an image of a man who ascribed great value to the ideas of colleagues.
In response to rising interest in autonomous vehicles, the federal government has called upon states not to authorize operation of self-driving cars, except for the purpose of testing.
With LEDs dropping in price virtually every year, automakers have begun employing them, not only on luxury vehicles, but on entry-level models, as well.
Using almost 200 light-emitting diodes in the front and back of the new 2014 CTS, Cadillac designers are showing how LEDs can change the character of a vehicle.
From Dell / Intel® New Paradigms in Design Work Scott Hamilton, vertical market strategist for Dell Precision workstations, 5/2/2013 5
Early in my career, I worked as a draftsman and remember the days of drawing on vellum with numbered pencils and Mylar with plastic lead. This was a fun experience in the sense that I ...
I've been using workstations for more than 10 years and love finding ways to get more performance from my system. With demanding professional applications that require more power each ...
A lasting memory from my first job as an engineer in an auto assembly plant is standing on hard concrete at six in the morning, vending-machine coffee clutched in hand, listening to ...
For industrial control applications, or even a simple assembly line, that machine can go almost 24/7 without a break. But what happens when the task is a little more complex? That’s where the “smart” machine would come in. The smart machine is one that has some simple (or complex in some cases) processing capability to be able to adapt to changing conditions. Such machines are suited for a host of applications, including automotive, aerospace, defense, medical, computers and electronics, telecommunications, consumer goods, and so on. This radio show will show what’s possible with smart machines, and what tradeoffs need to be made to implement such a solution.
To save this item to your list of favorite Design News content so you can find it later in your Profile page, click the "Save It" button next to the item.
If you found this interesting or useful, please use the links to the services below to share it with other readers. You will need a free account with each service to share an item via that service.