Firewall Wizards mailing list archives
RE: Re: Flawed Surveys [was: VPN endpoints]
From: "Tina Bird" <tbird () precision-guesswork com>
Date: Wed, 1 Sep 2004 13:35:06 -0700
Whatever you do is only as good as your starting hypothesis, the operational definitions which you create, and your experimental techniques.
My experience is marginally similar to Bruce's, in that prior to becoming a computer security architect, I was an observational astrophysicist. My Ph.D is on hypothesis testing and the use of statistics to study the gravitational evolution of clusters of galaxies. There are a lot of different, orthogonal bits of the current discussion: 1) Did anyone claim that surveys about security are "science"? In particular, is there a hypothesis being tested? If there is a stated hypothesis, is a survey the best way to test it? If it's not testable -- or more strongly, if it can't be disproved -- it's not science. 2) What is the purpose of the survey author? 3) What do we hope to learn from surveys about security? 4) How do we want to use surveys about security? When I'm in a particularly rebellious mood, I like to argue about the entire
existence< of the discipline of >>computer science<< -- what are the
underlying theories and how do you test them? Little of what I >>do<< now has anything to do with science, although a lot of the skills I use day to day are similar to things I did for my research job. I don't think that surveys are designed to be observations that test a theory. cheers -- tbird _______________________________________________ firewall-wizards mailing list firewall-wizards () honor icsalabs com http://honor.icsalabs.com/mailman/listinfo/firewall-wizards
Current thread:
- Re: VPN endpoints Kevin Sheldrake (Sep 01)
- <Possible follow-ups>
- Re: VPN endpoints Paul D. Robertson (Sep 01)
- Re: Flawed Surveys [was: VPN endpoints] Marcus J. Ranum (Sep 01)
- Re: Flawed Surveys [was: VPN endpoints] Paul D. Robertson (Sep 01)
- Re: Flawed Surveys [was: VPN endpoints] Marcus J. Ranum (Sep 01)
- Re: Flawed Surveys [was: VPN endpoints] Paul D. Robertson (Sep 01)
- Re: Re: Flawed Surveys [was: VPN endpoints] Christopher Hicks (Sep 01)
- Re: Flawed Surveys [was: VPN endpoints] Marcus J. Ranum (Sep 01)
- Re: Re: Flawed Surveys [was: VPN endpoints] Bruce B. Platt (Sep 01)
- RE: Re: Flawed Surveys [was: VPN endpoints] Tina Bird (Sep 01)
- Re: Re: Flawed Surveys [was: VPN endpoints] Bruce B. Platt (Sep 01)
- RE: Re: Flawed Surveys [was: VPN endpoints] Tina Bird (Sep 01)
- Re: Re: Flawed Surveys [was: VPN endpoints] Bruce B. Platt (Sep 01)
- Wired article on the scientific method Tina Bird (Sep 01)
- Re: Re: Flawed Surveys [was: VPN endpoints] Paul D. Robertson (Sep 01)
- Re: Re: Flawed Surveys [was: VPN endpoints] Crispin Cowan (Sep 01)
- Re: Re: Flawed Surveys [was: VPN endpoints] Adam Shostack (Sep 03)