Hortonworks Cybersecurity Platform
Also available as:
PDF
loading table of contents...

Setting up pcap to View Your Raw Data

Because the pcap data source creates an Apache Storm topology that can rapidly ingest raw data directly into HDFS from Apache Kafka, you can store all of your cybersecurity data in its raw form in HDFS and review or query it at a later date.

HCP supports two pcap components:
  • The pycapa tool, for low-volume packet capture

  • The Fastcapa tool, or high-volume packet capture

    Fastcapa is a probe that performs fast network packet capture by leveraging Linux kernel-bypass and user space networking technology. The probe will bind to a network interface, capture network packets, and send the raw packet data to Kafka. This provides a scalable mechanism for ingesting high-volumes of network packet data into a Hadoop cluster.

    Fastcapa leverages the Data Plane Development Kit (DPDK). DPDK is a set of libraries and drivers to perform fast packet processing in Linux user space.