for display only
Big Blue Interactive The Corner Forum  
Back to the Corner

Archived Thread

I read Summer School “analytics” and as my eyes glazed over

plato : 5/31/2020 4:06 pm
in a mass of definitions, I had one question. How have any of these concepts been tested as to “falsification” in their usefulness in the NFL (or “truth” if you prefer)

if that is the point could someone explain to me what the process was and what did it reveal about any of those mass of “definitions”. If that is not the point, than would someone have some mercy (rarely found on bbi) and explain what am I to get from summer school. Thanks in advance
Pages: 1 2 <<Prev | Show All |
The way people sell them as magic is flawed  
NoGainDayne : 6/1/2020 1:53 pm : link
but I’d say that’s a result of insufficient data or problem structuring (tackling something do big without chunking the problem) but it doesn’t mean nonlinear methods are flawed. There are many successful implementations. Many more bad ones but it doesn’t make the tools flawed
Of course they are a highly flawed tool. You’re dealing  
kicker : 6/1/2020 2:38 pm : link
with human behavior. Any analysis, linear or nonlinear, rests on assumptions that average reality. Flaw. Also rests on a built model, which is subject to any number of statistical and personal biases.

I’m not talking about the math, I’m talking about the linear, non linear, non parametric, what have you analysis that utilizes the math.

I mean, any optimization problem (which is any analytic tool), by definition, is trying to reduce some “error”/flaw. Mean squared error, etc. Even machine learning is optimized to reduce some frictional error/flaw term.
And I know nonlinear is the new buzzword, because  
kicker : 6/1/2020 2:39 pm : link
most of my published research utilizes those methods.

But we have to accept they are highly flawed and then we can have an honest discussion of how much can be learned, even with “big data”.
I think my point is both high powered simulation  
NoGainDayne : 6/1/2020 2:50 pm : link
tech leveraging purely nonlinear methods.

There are much more structured solutions.

Both are important and these problems can be solved. But ignoring especially building out an excellent data collection effort with hopefully human interaction and reinforcement learning you are putting itself at a disadvantage to those that have those systems and have had those systems. Because you can ramp up and simulate later but nothing beats people interacting with live outputs.
Highly flawed  
kicker : 6/1/2020 3:00 pm : link
does not mean useless.

Every analytics method is highly flawed, which includes “intuition”, which is also a “nonlinear” analytics method.
And your point is that more information is better, and new  
kicker : 6/1/2020 3:03 pm : link
data should always be collected.

That would be much better received than talking about “nonlinear”, or drones, or HIGGS-Boson particles.
And frankly, anytime people start talking about "big data", "nonlinear  
kicker : 6/1/2020 3:09 pm : link
"machine learning", or "predictive analytics", a lot of people roll their eyes.

A lot of people build models; there is absolutely nothing unique about that. Most people build shitty models, but doll it up in "nonlinear dynamics", or "stochastic processes", or some other term du jour.

People would be much better served understanding the intuition behind the models and explaining it in simple terms. But it requires a deeper understanding of all of these highly complex models and systems that a lot of people don't have. People can replicate this; understanding and being able to concisely convey that information without using any jargon should be the holy grail.
RE: And frankly, anytime people start talking about  
FatMan in Charlotte : 6/1/2020 3:16 pm : link
In comment 14914250 kicker said:
Quote:
"machine learning", or "predictive analytics", a lot of people roll their eyes.

A lot of people build models; there is absolutely nothing unique about that. Most people build shitty models, but doll it up in "nonlinear dynamics", or "stochastic processes", or some other term du jour.

People would be much better served understanding the intuition behind the models and explaining it in simple terms. But it requires a deeper understanding of all of these highly complex models and systems that a lot of people don't have. People can replicate this; understanding and being able to concisely convey that information without using any jargon should be the holy grail.


That's a great post. Doing this also bridges the perception gap of oafy football people vs. brainiacs with fancy data.

It would avoid the pedantic arguments about 4 computer guys and shunning technology. The best speaker I've ever heard on analytics was breaking it down so a group of contractors and construction guys could understand it. Everyone learned a lot that day because fancy terms weren't taking away from the message.
I think it’s quite relevant when people act like  
NoGainDayne : 6/1/2020 3:17 pm : link
football is beyond the scope of being able to analyze with purely nonlinear methods. Which yes there are an abundance of human and non human. But no you do not need to understand what is going on under the hood of something or what their commands are to predict their movements effectively.

Can more experts and structuring help, they sure can. But just because there is a lot of snake oil and buzzwords around doesn’t mean football isn’t a realistic analytical challenge to make big strides on today.

But if your point is it’s hard and complicated I don’t understand what so special about that point either. I wasn’t saying it wasn’t. Not sure who was.

There are people saying it can’t really be done effectively and I think that’s the inaccurate statement.
Great. Nonlinear.  
kicker : 6/1/2020 3:21 pm : link
I have absolutely no more desire to continue this.
There are people saying..  
FatMan in Charlotte : 6/1/2020 3:25 pm : link
it is really difficult to do effectively, not that it can't be done.

And there are people saying it can be potentially as bad to have a flawed system put in place than the coach intuitive system predominantly used today.

Anyone going up to an NFL team today and promising that they can improve their performance through analytics or can revamp their interpretation of data to achieve a specific goal are selling them snake oil.

And I really don't know why you're hung up on movement analysis.
Nonlinear came in when people were talking about trend lines  
NoGainDayne : 6/1/2020 3:42 pm : link
and I think it beats the merits of discussing say different types of neural nets and optimization functions when we don’t have data to discuss.

Some people connect more with abstractions of successful advanced applications of the tech and some people don’t.

The benefits of slides and pictures are also incredibly helpful in understanding how these things work.

Psychological factors, even nutrition is making its way into these larger analysis as well. I think any flaws of a system are easily covered up by not making the system the decision point but something to learn from
until you actually trust it.

However, buying into the validity of the ultimate solution and trying to over structure something as a substitute for broad based tool and solution exploration could very well result in you building a lesser system.






Last sentence should say  
NoGainDayne : 6/1/2020 3:44 pm : link
not buying into
RE: There are people saying..  
christian : 6/1/2020 3:55 pm : link
In comment 14914265 FatMan in Charlotte said:
Quote:
Anyone going up to an NFL team today and promising that they can improve their performance through analytics or can revamp their interpretation of data to achieve a specific goal are selling them snake oil.


I don't know about making promises, but I'm professionally famaliar with a few companies doing really interesting work with select NFL teams -- the most interesting and I think the most likely to bear fruit is telemetric analysis.

There's a body of data that shows pretty clearly that in-uniform timed speed in conjunction with lining up in the slot versus on the line, has a direct relationship to achieving the seperation rate that is most correlated with catch rate.

There are a bunch of these out there to uncover, that the tech is maturing to a place it can be useful.
.  
Bill2 : 6/1/2020 5:28 pm : link
why would that take analysis?

On the line the chances of being deflected off optimal arrival point is higher. Even if the receiver has to swivel his head more or further to avoid an actual deflection.

How does that reality affect the use of drone based spatial analysis?

In world class sprinting one quarter turn of the head to see a rival lane costs enough to lose the race. So guys who glance at the whole field ahead wreck their own optimal speed versus a dummy who ploughs straight ahead but gets higher average speed to a straight first point of demarcation?

So Ron Dayne really was more desirable than Barry Sanders or Gayle Sayers who wasted drone time looking ahead? Can we get their gold jackets back?

Just a simple example of how many exogenous and non linear variables (a slight ankle sprain in the 3rd quarter that takes a play or two to shake off) remain between hypothesis and utility.

Where would you invest? One more scout so each has mess territory to cover thoroughly or an ex General Dynamics/Raytheon Researcher who worked on the drone module of the Aegis System?

.  
Bill2 : 6/1/2020 5:39 pm : link
less territory to thoroughly cover
One of the reasons I brought up Higgs boson is it was  
NoGainDayne : 6/1/2020 5:51 pm : link
a kaggle competition. I don’t think the skills needed to make grounds on these problems are too astronomical. Which is why the scouting and technology professionals should be well within the budget of an NFL team. The Yankees I believe employ 20 people for their analysis operation.

I believe one of them is a former aerospace engineer too. I’d have to go back and check again to confirm though.

RE: .  
christian : 6/1/2020 6:28 pm : link
In comment 14914318 Bill2 said:
Quote:
why would that take analysis?


Ron Dayne vs. Gale Sayers? Sure.

Sterling Shepard vs. Golden Tate. More interesting.

On the field who's actually faster? Who can get closer to a seperation radius that benefits their catch rate off the line than in the slot? You can only play one in the slot, who is it going to be?

How is the decision being made today?

If the tech is 50K and requires only video analysis and no Bendix contractors, and the death of no scouts?
with outside consultants  
Bill2 : 6/1/2020 6:32 pm : link
assigned to projects, programmers contracted and filling out the minor leagues and scouting operations they have far more manpower ( direct and indirect) on the analytical side. They use outside grants to universities for some of their strength and conditioning research

Add their enormous array of coaches, specialists ( pitch recognition, weight shift techniques, and enormous video capture and editing staff)strength and conditioning coaches and people who teach language, handling the media, getting credit, buying and renting ( they actually teach these things, on staff counseling and psychiatrists, physical therapists in many different injuries, getting their kids out of legal issues, green card, passport, family issues.

The Yankees ( and Dodgers and maybe Atlanta) dwarf the Patriots expenditure level. And they keep adding.

We many think Cashman is a PR front. He is a technology center manager.
christian  
Bill2 : 6/1/2020 6:35 pm : link
With the injury rate and differing recovery rates depending on those injuries and potential for either to not be with us next year?
RE: christian  
christian : 6/1/2020 6:52 pm : link
In comment 14914352 Bill2 said:
Quote:
With the injury rate and differing recovery rates depending on those injuries and potential for either to not be with us next year?


If all the tape is preloaded and tagged in the DB, and it takes 3 hours to run the script, one more low cost data point.

If Tate has a sprained ankle, index that above new nifty, potentially irrelevant
catch radius/seperation rate measurement
, in the decision tree ;)
So the data comes back  
Bill2 : 6/1/2020 7:45 pm : link
and reveals no real change from normal range.

DJ sees him getting up slowly from a prior play or notices he is taking in a lot of Gatorade on a hot day in the third quarter.

Analytics or instinct from years of playing football guides the answer?

My question has nothing to do with how to do the analysis. My question has to do with ROU up against other alternative wise uses of time and dollars.

My instinct is that what can be explored and what gets done will be quite different.

Look at the concerns about absorbing a new playback in time. There is an absorbtion rate during the season that hints at these insights needing to be both significant and pre season. ( or most promising...in data gathered pre draft).

Imo

Gimme shelter  
Bill2 : 6/1/2020 7:46 pm : link
ROI
and  
Bill2 : 6/1/2020 7:47 pm : link
playbook

Time to quit for this is beyond ROI OR ROU
Bill I think it’s a lot closer to being done  
NoGainDayne : 6/2/2020 12:14 pm : link
cheaper than you think where it can add value early and often by organizing the data collection, problems and interaction in intelligent ways.

Christian and I have both been focused on the leadership aspect of it, getting a strong CTO, because that is far more important than the number of coders.
Even your example of a playbook  
NoGainDayne : 6/2/2020 12:18 pm : link
there are learning systems that could be set up that could both speed along that process and feed into play calling systems for the team.

Even systems to deduce learning the best combinations of learning styles and that’s a whole new world because we don’t know how many players might have done better with an alternative to memorizing a playbook.
Pages: 1 2 <<Prev | Show All |
Back to the Corner