How to collect figures of traffic used per-host, broken up by time and destination?

Posted by Seishun on Server Fault See other posts from Server Fault or by Seishun
Published on 2011-01-11T05:09:47Z Indexed on 2011/01/11 5:55 UTC
Read the original article Hit count: 200

Filed under:

pfsense

|

traffic-management

We have a relatively small network, all PSs in one subnet. One PC with two NICs and pfSense installed works as a firewall/router. There is an OpenVPN tunnel to a remote location, created as a site-to-site connection to another pfSense box there.

I have an assignment to capture, store and show (via a web interface) information on traffic generated (both incoming and outcoming) by each host on our subnet and present it in several views:

megabytes per calendar hours / days / months / years (that is, not just "one month back", but "in Dec 2010" and so on);
megabytes per destination: VPN to remote location / other destinations / Google Apps servers.

I tried the software packages in pfSense that offer traffic montoring - but it seems they don't store the information fixed by months, instead showing the amounts of traffic generated in periods (days/months/etc) calculated from the present moment.

I'm also interested in understanding what would be the best way for me to break up traffic by hosts and destinations.

I'm open to all suggestions, even if they mean that I will have to understand something new to me.

© Server Fault or respective owner

Related posts about pfsense

Using pfSense, OpenVPN Connects but Still Can't See the Network

as seen on Super User - Search for 'Super User'
I am having an OpenVPN issue. I have a pfSense box at home configured to allow traffic through a VPN tunnel. The client computer is Windows XP Home, behind a standard Comcast connection and a Netgear wireless router. I use OpenVPN to access my work network (from where I am trying to get out of… >>> More
Ierrs on Network Interface - Pfsense/Freebsd

as seen on Server Fault - Search for 'Server Fault'
Hello all, We're using PfSense as an internal router/firewall (no connection to WAN). Using the Web-GUI, under Status --- Interfaces, there's one particular interface where I have some errors: In/out errors 3513/0 I then SSHed to the firewall to validate the info provided by the WebGUI and… >>> More
pfSense Firewall or Linsys/Cisco router for small offices

as seen on Server Fault - Search for 'Server Fault'
I'm about to start switching some networks around for multiple small offices. Each office has about 10 to 15 users and 10 to 15 computers. Each office has a spread of generic routers and access points. The routers vary from being used as routers, to just being an access point for wireless. Nothing… >>> More
Per client DNS server assignment using Pfsense

as seen on Server Fault - Search for 'Server Fault'
I have a network where pfsense is the gateway. There are two sets of clients that I want. One where there will be some restrictions to the network (example, IM being blocked) and one network where there are no restrictions. One easy way I thought about doing this was assigning the different domains… >>> More
Route specific HTTP requests through pfSense OpenVPN

as seen on Server Fault - Search for 'Server Fault'
Hi, to start, I have very little knowledge on routes, iptables, etc. That said, here's what I'm trying to accomplish and where I think I'm stumped: Problem: We have an external website which we recently firewalled so it only accepts traffic from our office IP addresses. This works well at the office… >>> More

Related posts about traffic-management

Sharing Bandwidth and Prioritizing Realtime Traffic via HTB, Which Scenario Works Better?

as seen on Server Fault - Search for 'Server Fault'
I would like to add some kind of traffic management to our Internet line. After reading a lot of documentation, I think HFSC is too complicated for me (I don't understand all the curves stuff, I'm afraid I will never get it right), CBQ is not recommend, and basically HTB is the way to go for most… >>> More
Does anyone really understand how HFSC scheduling in Linux/BSD works?

as seen on Server Fault - Search for 'Server Fault'
I read the original SIGCOMM '97 PostScript paper about HFSC, it is very technically, but I understand the basic concept. Instead of giving a linear service curve (as with pretty much every other scheduling algorithm), you can specify a convex or concave service curve and thus it is possible to decouple… >>> More
managing a high traffic media sharing website

as seen on Server Fault - Search for 'Server Fault'
i'm in the process of developing a website that i predict will generate a lot of traffic. the site will be similar to many other sites offering free media streaming: mp3's. we are going to start with a pretty minimal amount of media to share, but the basic idea is that artists will set up a profile… >>> More
Is there a small business router that shows bandwidth usage graphs in the admin panel?

as seen on Server Fault - Search for 'Server Fault'
I support a large number of public libraries that are having their networks upgraded in response to a grant application. These libraries are generally home to between 6-15 computers and have little or no tech services either onsite or contracted remotely. In order to justify current and future… >>> More
How to monitor traffic on certain ports with ntop

as seen on Server Fault - Search for 'Server Fault'
How to configure ntop so I can get the amount of upload traffic sent through a certain port ? I've added port in ntop/protocol.list, restarted ntop and after some time I've checked Summary - Traffic - TCP/UDP Traffic Port Distribution: Last Minute View, but data from that table is not too relevant… >>> More