Re: Fwd: hadoop and hbase information gathering

[John Bond <john.r.bond () gmail com>]

On 13 October 2011 23:47, Patrick Donnelly <batrick () batbytes com> wrote:
> On Thu, Oct 13, 2011 at 5:04 PM, Patrick Donnelly <batrick () batbytes com> wrote:
> > On Thu, Oct 13, 2011 at 4:17 PM, David Fifield <david () bamsoftware com> wrote:
> > > On Thu, Oct 13, 2011 at 12:32:01AM +0200, John Bond wrote:
> > > > > Can you recommend an easy way to set up Hadoop and Hbase to test?
> > > >
> > > > how much capacity do you have 1-4 machines? let me know and i can give
> > > > you guidelines.  if you are familiar with cfengine 3 i can send you my
> > > > policies.
> > >
> > > Um, I can set up some VMs I guess? I've never used Hadoop nor Hbase, and
> > > "apt-get install hadoop" didn't work. I don't know what cfengine is. Is
> > > there a way to set up a minimal "cluster" of one machine?
> >
> > I have a Hadoop cluster here to play with at my University. I'll give
> > the scripts a go.
>
> Attached is the output I get from running:
>
> ./nmap --datadir $PWD --script $HOME/hadoop-nse -p 8020,8030,8033,8023
> -vv -dd -n -PN namenode-hostname > OUTPUT 2>&1
>
> I had to modify the scripts (inside $HOME/hadoop-nse) to work on those
> ports. The ports we use are not the default ones. I think there should
> be service probes added so that this isn't necessary.
>
> There are script errors in the output because I changed the scripts to
> run the action against every port.
>
> The output from some scripts is empty. I don't know why. For example:
>
> | hadoop-namenode-info:
> |   Datanodes (Live):
> |_  Datanodes (Dead):
>
> Let me know if you want me to do additional tests...
>
> --
> - Patrick Donnelly
can you send me the output of the script with nmap -ddd (this will
produce a lot of output, some of which you may want to scrub)

@david it is no a simple task to set up hadoop, not sure if you can
even run everything on the same box.  ill try to build a vm or some
guidlines this weekend. in the mean time the cloudera docs are good
https://ccp.cloudera.com/display/DOC/Documentation
_______________________________________________
Sent through the nmap-dev mailing list
http://cgi.insecure.org/mailman/listinfo/nmap-dev
Archived at http://seclists.org/nmap-dev/