New to nav system

[m***@public.gmane.org]

Hello,
I just installed nav system from source, so I have 4.0b5 up and running.

I tried so far only few Cisco boxes of these two types
- Catalyst 6504
- Catalyst 4506

Even on these I'm unable to obtain software version, modules etc. It shows
serial numbers and ports (but not switch ports or router ports)

I tried to find out, how to troubhleshoot the proces, but nothing was usefull.

Can you please advise me, what can I do to make it work?

brgds

Mat

[Morten Brekkevold]

Post by m***@public.gmane.org
Hello,
I just installed nav system from source, so I have 4.0b5 up and running.
I tried so far only few Cisco boxes of these two types
- Catalyst 6504
- Catalyst 4506
Even on these I'm unable to obtain software version, modules etc. It shows
serial numbers and ports (but not switch ports or router ports)
I tried to find out, how to troubhleshoot the proces, but nothing was usefull.
Can you please advise me, what can I do to make it work?

Well, NAV shouldn't have a problem with the abovementioned device types.

Some questions:

- What category device did you add them as?

- If you browse the devices in NAV, what does their job status look
like, are all the jobs greenlighted?

- Are there any recent alerts listed when browsing the devices?

- Are there error messages related to these devices in `ipdevpoll.log`?

[M***@public.gmane.org]

Hi,

See attached picture of 3750-recognized device and 2960G-unrecognized.

There are actually some problems in ipdevpoll.log, but I think it should be
related to graphite not listening on UDP(1minstats and 5minstats). I forget
to start the carbon cache. After starting carbon there are no errors (half
an hour)

The jobs are all green.

As it does show no switchports, the ports tab is empty.

Any ideas?

brgds

Mat
-----Original Message-----
From: Morten Brekkevold [mailto:morten.brekkevold-***@public.gmane.org]
Sent: Thursday, March 20, 2014 12:07 PM
To: JABUREK Martin
Cc: nav-users-***@public.gmane.org
Subject: Re: New to nav system

Post by m***@public.gmane.org
Hello,
I just installed nav system from source, so I have 4.0b5 up and running.
I tried so far only few Cisco boxes of these two types
- Catalyst 6504
- Catalyst 4506
Even on these I'm unable to obtain software version, modules etc. It
shows serial numbers and ports (but not switch ports or router ports)
I tried to find out, how to troubhleshoot the proces, but nothing was usefull.
Can you please advise me, what can I do to make it work?

Well, NAV shouldn't have a problem with the abovementioned device types.

Some questions:

- What category device did you add them as?

- If you browse the devices in NAV, what does their job status look
like, are all the jobs greenlighted?

- Are there any recent alerts listed when browsing the devices?

- Are there error messages related to these devices in `ipdevpoll.log`?

--
Morten Brekkevold
UNINETT

[Morten Brekkevold]

Post by M***@public.gmane.org
See attached picture of 3750-recognized device and 2960G-unrecognized.
There are actually some problems in ipdevpoll.log, but I think it should be
related to graphite not listening on UDP(1minstats and 5minstats). I forget
to start the carbon cache. After starting carbon there are no errors (half
an hour)
The jobs are all green.
As it does show no switchports, the ports tab is empty.
Any ideas?

Yes, you need to check your `ipdevpoll.log` more closely. For some
reason, the inventory job has not run at all (neither success or failure
has been logged in your jobs listing) for the devices you posted in your
screenshots, but other jobs have run. The inventory job will, as the
name implies, collect all kinds of inventory information about your
devices - switch- and router ports, modules, serial numbers, etc.

Any reference to the inventory job in the logs would be interesting.
Also, the default log level is a bit high; you would to well to lower it
somewhat:

Add a new file called `logging.conf` to your NAV config directory and
add the following two lines, then restart ipdevpoll:

[levels]
nav = INFO

[M***@public.gmane.org]

Hi,

Finally the problem solved itself - I had to restart nav services, (Maybe it
was due to previous problems with connectivity to carbon backend).

Now I have all the information needed from supported devices (3750 and 6504)

My ipdevpoll.log now only displays these errors:

2014-03-21 15:55:11,057 [WARNING plugins.typeoid.typeoid] [inventory xxx]
Netbox has changed type from unknown to unknown (sysObjectID
1.3.6.1.4.1.9.1.875)
2014-03-21 15:55:11,084 [WARNING plugins.typeoid.typeoid] [inventory xxx]
Netbox has changed type from unknown to unknown (sysObjectID
1.3.6.1.4.1.9.1.875)
2014-03-21 15:55:11,086 [WARNING plugins.typeoid.typeoid] [inventory xxx]
Netbox has changed type from unknown to unknown (sysObjectID
1.3.6.1.4.1.9.1.874)
2014-03-21 15:55:11,087 [WARNING plugins.typeoid.typeoid] [inventory xxx]
Netbox has changed type from unknown to unknown (sysObjectID
1.3.6.1.4.1.9.1.874)
2014-03-21 15:55:11,088 [WARNING plugins.typeoid.typeoid] [inventory xxx]
Netbox has changed type from unknown to unknown (sysObjectID
1.3.6.1.4.1.9.1.696)

These are also cisco so I expect that it should be only needed to insert
some mapping to database?

I would be also interested to insert some Juniper and checkpoint firewalls
(because of MAC/IP mapping) is it possible?

Thank you so far

Mat
-----Original Message-----
From: Morten Brekkevold [mailto:morten.brekkevold-***@public.gmane.org]
Sent: Friday, March 21, 2014 3:09 PM
To: JABUREK Martin
Cc: nav-users-***@public.gmane.org
Subject: Re: New to nav system

Post by M***@public.gmane.org
See attached picture of 3750-recognized device and 2960G-unrecognized.
There are actually some problems in ipdevpoll.log, but I think it
should be related to graphite not listening on UDP(1minstats and
5minstats). I forget to start the carbon cache. After starting carbon
there are no errors (half an hour)
The jobs are all green.
As it does show no switchports, the ports tab is empty.
Any ideas?

Yes, you need to check your `ipdevpoll.log` more closely. For some reason,
the inventory job has not run at all (neither success or failure has been
logged in your jobs listing) for the devices you posted in your screenshots,
but other jobs have run. The inventory job will, as the name implies,
collect all kinds of inventory information about your devices - switch- and
router ports, modules, serial numbers, etc.

Any reference to the inventory job in the logs would be interesting.
Also, the default log level is a bit high; you would to well to lower it
somewhat:

Add a new file called `logging.conf` to your NAV config directory and add
the following two lines, then restart ipdevpoll:

[levels]
nav = INFO


--
Morten Brekkevold
UNINETT

[Morten Brekkevold]

Post by M***@public.gmane.org
Finally the problem solved itself - I had to restart nav services, (Maybe it
was due to previous problems with connectivity to carbon backend).

Yes, it could be. We haven't tested enough how our code handles a
missing Graphite backend.

Post by M***@public.gmane.org
Now I have all the information needed from supported devices (3750 and 6504)
2014-03-21 15:55:11,057 [WARNING plugins.typeoid.typeoid] [inventory xxx]
Netbox has changed type from unknown to unknown (sysObjectID
1.3.6.1.4.1.9.1.875)

These aren't errors, they are warnings. They should probably be INFO
level messages, though. These are just to assert that the device appears
to have been replaced with another type of device; you will see this on
the first run for all devices, since their type is, by definition,
unknown before we query them.

Post by M***@public.gmane.org
These are also cisco so I expect that it should be only needed to insert
some mapping to database?

The message says the new type is unknown, as the 1.3.6.1.4.1.9.1.875
sysObjectID was not previously registered in your database. ipdevpoll
will have created a device type for 1.3.6.1.4.1.9.1.875, used the
device's sysDescr value as a type description, and attached it to the
'unknown' vendor.

You can find the generated 1.3.6.1.4.1.9.1.875 type in the SeedDB "Type"
tab. Change the vendor Cisco, and update the description and typename as
you please.

Post by M***@public.gmane.org
I would be also interested to insert some Juniper and checkpoint firewalls
(because of MAC/IP mapping) is it possible?

As long as they provide ARP and/or ND mappings in the IETF-standard IP-MIB, you should
be fine (RFC 4293, alternately the obsoleted RFC 2011).

[M***@public.gmane.org]

Hi,

I modified the unknown OIDs and now I am able to collect information from
boxes.

Now I have these issues:
- graphs showing throughput - there are only empty graphs on port info tabs.
I think that backend should be fine, because I can see some graphs (for
example SystemMetrics/CPU are all fine)
Maybe it is related to a fetch error from statistics pane. (see screenshot)

- I am getting these logs from ipdevpoll.log:
2014-03-23 22:59:09,943 [WARNING plugins.dnsname.dnsname] [inventory IP1] Box
dnsname has changed from u 'IP1' to 'DNS1'
2014-03-24 04:59:09,673 [WARNING plugins.dnsname.dnsname] [inventory IP2] Box
dnsname has changed from u 'IP2' to 'DNS2'
When I edit device it gets the right name, but it keep reporting only IP. This
started when I added unknown device and now I corrected it. So I have other
devices with right DNS names as sysnames.

- how can I change the look of graphs? I'm getting black backgrounded graphs
which are really ugly on white background.

The work done is really amazing. I look forward when I have it finally fully
up.

Mat
-----Original Message-----
From: Morten Brekkevold [mailto:morten.brekkevold-***@public.gmane.org]
Sent: Monday, March 24, 2014 9:22 AM
To: JABUREK Martin
Cc: nav-users-***@public.gmane.org
Subject: Re: New to nav system

Post by M***@public.gmane.org
Finally the problem solved itself - I had to restart nav services,
(Maybe it was due to previous problems with connectivity to carbon backend).

Yes, it could be. We haven't tested enough how our code handles a missing
Graphite backend.

Post by M***@public.gmane.org
Now I have all the information needed from supported devices (3750 and 6504)
2014-03-21 15:55:11,057 [WARNING plugins.typeoid.typeoid] [inventory
xxx] Netbox has changed type from unknown to unknown (sysObjectID
1.3.6.1.4.1.9.1.875)

These aren't errors, they are warnings. They should probably be INFO level
messages, though. These are just to assert that the device appears to have
been replaced with another type of device; you will see this on the first run
for all devices, since their type is, by definition, unknown before we query
them.

Post by M***@public.gmane.org
These are also cisco so I expect that it should be only needed to
insert some mapping to database?

The message says the new type is unknown, as the 1.3.6.1.4.1.9.1.875
sysObjectID was not previously registered in your database. ipdevpoll will
have created a device type for 1.3.6.1.4.1.9.1.875, used the device's sysDescr
value as a type description, and attached it to the 'unknown' vendor.

You can find the generated 1.3.6.1.4.1.9.1.875 type in the SeedDB "Type"
tab. Change the vendor Cisco, and update the description and typename as you
please.

Post by M***@public.gmane.org
I would be also interested to insert some Juniper and checkpoint
firewalls (because of MAC/IP mapping) is it possible?

As long as they provide ARP and/or ND mappings in the IETF-standard IP-MIB,
you should be fine (RFC 4293, alternately the obsoleted RFC 2011).

--
Morten Brekkevold
UNINETT

[John-Magne Bredal]

Post by M***@public.gmane.org
I modified the unknown OIDs and now I am able to collect information from
boxes.

Great!

Post by M***@public.gmane.org
- graphs showing throughput - there are only empty graphs on port info tabs.
I think that backend should be fine, because I can see some graphs (for
example SystemMetrics/CPU are all fine)
Maybe it is related to a fetch error from statistics pane. (see screenshot)

See below.

Post by M***@public.gmane.org
2014-03-24 04:59:09,673 [WARNING plugins.dnsname.dnsname] [inventory IP2] Box
dnsname has changed from u 'IP2' to 'DNS2'
When I edit device it gets the right name, but it keep reporting only IP. This
started when I added unknown device and now I corrected it. So I have other
devices with right DNS names as sysnames.

We think this may be related to this bug:
https://bugs.launchpad.net/nav/+bug/1292513 . This has been fixed and will be
part of the next release.

The port statistics are probably being stored using the IP-address not the DNS
name of the IP Device. You can verify this by browsing the Graphite Web
interface and see which nodes are present under nav.devices.

Try restarting ipdevpoll. This may fix your current problem.

Post by M***@public.gmane.org
- how can I change the look of graphs? I'm getting black backgrounded graphs
which are really ugly on white background.

In the graphite configuration directory (perhaps /opt/graphite/conf), copy the
file graphTemplates.conf.example to graphTemplates.conf. Then edit it and add
the following:

[nav]
background = white
foreground = black

Post by M***@public.gmane.org
The work done is really amazing. I look forward when I have it finally fully
up.

Thank you! :)

[M***@public.gmane.org]

Hi,

Regarding the bug - I'm using 4.0b5 right now. Is the patch also applicable
for this version?

Restarting ipdevpoll does help, but not for the first time. I had to restart
it repeatadly (I did it due to other errors and then I mention, that it
corrected it)

Regarding the graphs I think there is some problem with graphing/storing data?
I attached three pictures:
Ten correct.png ... correct graph from rrdtools
Ten graphite.png ... graph collected from graphite web interface
Ten nav.png ... graph collected from nav interface

It seems to me, that graphite stores too few datapoints, I tried to dump raw
data and I get this:

nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:16:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:17:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:18:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:19:00,6302589367015099.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:20:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:21:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:22:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:23:00,6302603784021890.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:24:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:25:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:26:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:27:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:28:00,6302617817392692.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:29:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:30:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:31:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:32:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:33:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:34:00,6302631305894654.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:35:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:36:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:37:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:38:00,6302639660718015.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:39:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:40:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:41:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:42:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:43:00,6302653053594991.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:44:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:45:00,

Shouldn't I set up scheme for carbon database to await only 5 min collections?
It seems to me, that after applying derivative function it show nothing due to
empty datapoints.

Mat
-----Original Message-----
From: John-Magne Bredal [mailto:john.m.bredal-***@public.gmane.org]
Sent: Monday, March 24, 2014 2:36 PM
To: JABUREK Martin; Morten Brekkevold
Cc: nav-users-***@public.gmane.org
Subject: Re: New to nav system

Post by M***@public.gmane.org
I modified the unknown OIDs and now I am able to collect information
from boxes.

Great!

Post by M***@public.gmane.org
- graphs showing throughput - there are only empty graphs on port info tabs.
I think that backend should be fine, because I can see some graphs
(for example SystemMetrics/CPU are all fine) Maybe it is related to a
fetch error from statistics pane. (see screenshot)

See below.

Post by M***@public.gmane.org
2014-03-24 04:59:09,673 [WARNING plugins.dnsname.dnsname] [inventory
IP2] Box dnsname has changed from u 'IP2' to 'DNS2'
When I edit device it gets the right name, but it keep reporting only
IP. This started when I added unknown device and now I corrected it.
So I have other devices with right DNS names as sysnames.

We think this may be related to this bug:
https://bugs.launchpad.net/nav/+bug/1292513 . This has been fixed and will be
part of the next release.

The port statistics are probably being stored using the IP-address not the DNS
name of the IP Device. You can verify this by browsing the Graphite Web
interface and see which nodes are present under nav.devices.

Try restarting ipdevpoll. This may fix your current problem.

Post by M***@public.gmane.org
- how can I change the look of graphs? I'm getting black backgrounded
graphs which are really ugly on white background.

In the graphite configuration directory (perhaps /opt/graphite/conf), copy the
file graphTemplates.conf.example to graphTemplates.conf. Then edit it and add
the following:

[nav]
background = white
foreground = black

Post by M***@public.gmane.org
The work done is really amazing. I look forward when I have it finally
fully up.

Thank you! :)


--
John-Magne Bredal
UNINETT AS

[M***@public.gmane.org]

Hi,

I'm stupid. I forget to update etc/graphite/storage-schemas.conf and
etc/graphite/storage-aggregation.conf.

I deleted all whisper databases and hopefully it will be much better now.

Mat

-----Original Message-----
From: JABUREK Martin
Sent: Tuesday, March 25, 2014 3:55 PM
To: 'John-Magne Bredal'; Morten Brekkevold
Cc: nav-users-***@public.gmane.org
Subject: RE: New to nav system

Hi,

Regarding the bug - I'm using 4.0b5 right now. Is the patch also applicable
for this version?

Restarting ipdevpoll does help, but not for the first time. I had to restart

it repeatadly (I did it due to other errors and then I mention, that it
corrected it)

Regarding the graphs I think there is some problem with graphing/storing
data?
I attached three pictures:
Ten correct.png ... correct graph from rrdtools
Ten graphite.png ... graph collected from graphite web interface
Ten nav.png ... graph collected from nav interface

It seems to me, that graphite stores too few datapoints, I tried to dump raw

data and I get this:

nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:16:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:17:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:18:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:19:00,6302589367015099.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:20:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:21:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:22:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:23:00,6302603784021890.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:24:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:25:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:26:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:27:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:28:00,6302617817392692.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:29:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:30:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:31:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:32:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:33:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:34:00,6302631305894654.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:35:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:36:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:37:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:38:00,6302639660718015.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:39:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:40:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:41:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:42:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25
09:43:00,6302653053594991.0
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:44:00,
nav.devices.DEVICE.ports.Te1_1.ifInOctets,2014-03-25 09:45:00,

Shouldn't I set up scheme for carbon database to await only 5 min
collections?
It seems to me, that after applying derivative function it show nothing due
to
empty datapoints.

Mat
-----Original Message-----
From: John-Magne Bredal [mailto:john.m.bredal-***@public.gmane.org]
Sent: Monday, March 24, 2014 2:36 PM
To: JABUREK Martin; Morten Brekkevold
Cc: nav-users-***@public.gmane.org
Subject: Re: New to nav system

Post by M***@public.gmane.org
I modified the unknown OIDs and now I am able to collect information
from boxes.

Great!

Post by M***@public.gmane.org
- graphs showing throughput - there are only empty graphs on port info tabs.
I think that backend should be fine, because I can see some graphs
(for example SystemMetrics/CPU are all fine) Maybe it is related to a
fetch error from statistics pane. (see screenshot)

See below.

Post by M***@public.gmane.org
2014-03-24 04:59:09,673 [WARNING plugins.dnsname.dnsname] [inventory
IP2] Box dnsname has changed from u 'IP2' to 'DNS2'
When I edit device it gets the right name, but it keep reporting only
IP. This started when I added unknown device and now I corrected it.
So I have other devices with right DNS names as sysnames.

We think this may be related to this bug:
https://bugs.launchpad.net/nav/+bug/1292513 . This has been fixed and will
be
part of the next release.

The port statistics are probably being stored using the IP-address not the
DNS
name of the IP Device. You can verify this by browsing the Graphite Web
interface and see which nodes are present under nav.devices.

Try restarting ipdevpoll. This may fix your current problem.

Post by M***@public.gmane.org
- how can I change the look of graphs? I'm getting black backgrounded
graphs which are really ugly on white background.

In the graphite configuration directory (perhaps /opt/graphite/conf), copy
the
file graphTemplates.conf.example to graphTemplates.conf. Then edit it and
add
the following:

[nav]
background = white
foreground = black

Post by M***@public.gmane.org
The work done is really amazing. I look forward when I have it finally
fully up.

Thank you! :)


--
John-Magne Bredal
UNINETT AS

[Morten Brekkevold]

Post by M***@public.gmane.org
I'm stupid. I forget to update etc/graphite/storage-schemas.conf and
etc/graphite/storage-aggregation.conf.
I deleted all whisper databases and hopefully it will be much better now.

Yes, the storage schemas are quite important for good results :-)