MFDATA documentation

Table of Contents

• 1. Introduction to MFDATA
  • 1.1. What is mfdata?
  • 1.2. How do plugins work?
  • 1.3. Why would I use mfdata?
• 2. How to configure the metwork yum repository ?
  • 2.1. Prerequisites
  • 2.2. Choose a version
  • 2.3. Configure the metwork yum repository for CentOS 6 distribution
  • 2.4. Configure the metwork yum repository for CentOS 7 distribution
  • 2.5. Test
• 3. How to install/upgrade/remove mfdata metwork module (with internet access)
  • 3.1. Prerequisites
  • 3.2. Install mfdata metwork module
  • 3.3. Full installation
  • 3.4. Minimal installation
  • 3.5. Optional Addons
    • 3.5.1. Optional dependencies addons
    • 3.5.2. Optional mfdata addons
  • 3.6. Services
  • 3.7. Uninstall mfdata metwork module
  • 3.8. Upgrade mfdata metwork module
  • 3.9. Uninstall all metwork modules
  • 3.10. Upgrade all metwork modules
• 4. How to configure mfdata metwork module ?
  • 4.1. General
    • 4.1.1. How to configure a metwork module (mfserv, mfbase, mfdata…) during development process ?
    • 4.1.2. How to configure plugins during development process ?
    • 4.1.3. How to configure a metwork module (mfserv, mfbase, mfdata…) during production deployment process ?
    • 4.1.4. How to configure plugins during production deployment process ?
• 5. Loading MFDATA environment
  • 5.1. General
  • 5.2. Activate MFDATA environment by logging in as mfdata user.
  • 5.3. Activate MFDATA environment from any user.
  • 5.4. Activate MFDATA for one command only from any user.
  • 5.5. Miscellaneous
• 6. Quick Start
  • 6.1. Activate the MFDATA environment
  • 6.2. Create your first plugin
    • 6.2.1. Create the plugin
    • 6.2.2. Run the plugin
    • 6.2.3. Release the plugin
    • 6.2.4. Deploy the plugin
  • 6.3. Use of the ungzip plugin
• 7. How to create custom plugins
  • 7.1. Create and customize the plugin
  • 7.2. Plugin templates
    • 7.2.1. The move template
    • 7.2.2. The fork template
    • 7.2.3. The delete template
    • 7.2.4. The default template
    • 7.2.5. The archive template
    • 7.2.6. The ftpsend template
• 8. Debug a plugin
  • 8.1. Log level
  • 8.2. Run the plugin as an independent unit
• 9. Release and Deploy a plugin
  • 9.1. Release a plugin
  • 9.2. Deploy a plugin in a production environment
    • 9.2.1. The ‘basic’ way
    • 9.2.2. The ‘well-done’ way
  • 9.3. Override a plugin configuration
• 10. How it works ?
• 11. Additional Tutorials
  • 11.1. A PNG to JPEG conversion plugin
  • 11.2. Sending a file by FTP
  • 11.3. Create a plugin from scratch
    • 11.3.1. Create the plugin
    • 11.3.2. Set dependencies
    • 11.3.3. Fill in the plugin
    • 11.3.4. Override a configuration parameter
    • 11.3.5. Using the after callback
  • 11.4. Creating a batch plugin
  • 11.5. Implement custom monitoring and metrics in a plugin
    • 11.5.1. Add metrics in the Python code of the plugin
    • 11.5.2. Create a specific dashboard with our metrics
    • 11.5.3. View metrics on the dashboard
    • 11.5.4. Useful links and Tips
• 12. Plugins guide
  • 12.1. Plugins Configuration
  • 12.2. Plugins Commands
    • 12.2.1. plugins.list
    • 12.2.2. plugins.install
    • 12.2.3. plugins.uninstall
    • 12.2.4. plugins.info
    • 12.2.5. plugin_env
    • 12.2.6. plugin_wrapper
  • 12.3. Make Commands
    • 12.3.1. make develop
    • 12.3.2. make release
    • 12.3.3. make clean
    • 12.3.4. make superclean
    • 12.3.5. make
  • 12.4. Python virtualenv
    • 12.4.1. The ‘Simple’ requirements
    • 12.4.2. The ‘Exact’ Requirements
    • 12.4.3. The ‘Best’ Requirements
    • 12.4.4. Python3 requirements-to-freeze.txt
    • 12.4.5. Python2 requirements-to-freeze.txt
• 13. Identify particular types of files
  • 13.1. Introduction
  • 13.2. Example:
• 14. Miscellaneous
  • 14.1. The switch_logical_condition field
  • 14.2. The switch plugin tags attributes
  • 14.3. The .layerapi2_dependencies file
  • 14.4. The .layerapi2_extra_env file
  • 14.5. Inject data files in HTTP
  • 14.6. Plugins with more than one step
  • 14.7. The outside Metwork command
  • 14.8. The crontab support
  • 14.9. Extra daemon
  • 14.10. Access a database
• 15. MFDATA Log
  • 15.1. Default logs files
  • 15.2. Custom logs files
    • 15.2.1. Classic Python logger
    • 15.2.2. Metwork MFLOG logger
• 16. Tuning, Monitoring and Dashboard
  • 16.1. Tuning
    • 16.1.1. Number of processes
    • 16.1.2. Resource limits
    • 16.1.3. Miscellaneous
  • 16.2. Monitoring and Dashboards
    • 16.2.1. Monitor a plugin
    • 16.2.2. Dashboards
    • 16.2.3. Useful links and Tips
• 17. XATTRFILE API
  • 17.1. xattrfile Package
    • 17.1.1. Functions
    • 17.1.2. Classes
    • 17.1.3. Variables
    • 17.1.4. Class Inheritance Diagram
  • 17.2. xattrfile.print_tags Module
    • 17.2.1. Functions
  • 17.3. xattrfile.get_tag Module
    • 17.3.1. Functions
  • 17.4. xattrfile.set_tag Module
    • 17.4.1. Functions
• 18. ACQUISITION API
  • 18.1. acquisition Package
    • 18.1.1. Classes
    • 18.1.2. Class Inheritance Diagram
• 19. Layer root
  • 19.1. Overview
  • 19.2. Special focus on python wrappers
    • 19.2.1. python2 wrapper
    • 19.2.2. python3 wrapper
    • 19.2.3. python wrapper
  • 19.3. Metadata
    • 19.3.1. Layer Home
    • 19.3.2. Label
    • 19.3.3. Dependencies
  • 19.4. Utilities
    • 19.4.1. mfdata.start
    • 19.4.2. mfdata.stop
    • 19.4.3. mfdata.status
    • 19.4.4. mfdata.init
    • 19.4.5. mfdata_wrapper
• 20. Layer python2
  • 20.1. Overview
  • 20.2. Metadata
    • 20.2.1. Layer Home
    • 20.2.2. Label
    • 20.2.3. Dependencies
  • 20.3. Utilities
    • 20.3.1. inject_file
    • 20.3.2. print_tags
    • 20.3.3. get_tag
    • 20.3.4. set_tag
• 21. Layer python3
  • 21.1. Overview
  • 21.2. Metadata
    • 21.2.1. Layer Home
    • 21.2.2. Label
    • 21.2.3. Dependencies
  • 21.3. Utilities
    • 21.3.1. inject_file
    • 21.3.2. print_tags
    • 21.3.3. get_tag
    • 21.3.4. set_tag
• 22. Layer default
  • 22.1. Overview
  • 22.2. Metadata
    • 22.2.1. Layer Home
    • 22.2.2. Label
    • 22.2.3. Dependencies
• 23. CHANGELOGs
  • 23.1. release_0.8 CHANGELOG
    • 23.1.1. [Unreleased]
    • 23.1.2. v0.8.5 (2019-10-22)
    • 23.1.3. v0.8.4 (2019-09-22)
    • 23.1.4. v0.8.3 (2019-09-05)
    • 23.1.5. v0.8.2 (2019-08-29)
    • 23.1.6. v0.8.1 (2019-08-26)
    • 23.1.7. v0.8.0 (2019-08-14)
  • 23.2. release_0.7 CHANGELOG
    • 23.2.1. v0.7.4 (2019-09-05)
    • 23.2.2. v0.7.3 (2019-08-29)
    • 23.2.3. v0.7.2 (2019-06-13)
    • 23.2.4. v0.7.1 (2019-06-12)
    • 23.2.5. v0.7.0 (2019-05-24)
  • 23.3. release_0.6 CHANGELOG
    • 23.3.1. v0.6.2 (2019-06-12)
    • 23.3.2. v0.6.1 (2019-04-26)
    • 23.3.3. v0.6.0 (2019-04-01)
  • 23.4. release_0.5 CHANGELOG
    • 23.4.1. v0.5.10 (2019-04-26)
    • 23.4.2. v0.5.9 (2019-04-01)
    • 23.4.3. v0.5.8 (2019-03-22)
    • 23.4.4. v0.5.7 (2019-03-15)
    • 23.4.5. v0.5.6 (2019-03-04)
    • 23.4.6. v0.5.5 (2019-02-15)
    • 23.4.7. v0.5.4 (2019-02-06)
    • 23.4.8. v0.5.3 (2019-01-31)
    • 23.4.9. v0.5.2 (2019-01-31)
    • 23.4.10. v0.5.1 (2019-01-29)
    • 23.4.11. v0.5.0 (2019-01-29)
  • 23.5. release_0.4 CHANGELOG
    • 23.5.1. [Unreleased]
    • 23.5.2. v0.4.1 (2019-01-09)
    • 23.5.3. v0.4.0 (2019-01-08)

Indices and tables

• Index

• Module Index

• Search Page