Scraper for LatestVersions

CI-Pipeline Powered website scrapers for the latestversions project.

1. Table of Contents

• 1. Table of Contents
• 2. About The Project
  • 2.1. Built With
  • 2.2. Installation
• 3. Usage
  • 3.1. Github Repo
  • 3.2. X-Ray
• 4. Customising
• 5. Contributing
• 6. License
• 7. Contact

2. About The Project

The latestversions project https://latest-versions.netlify.app/ has a number of scrapers that go to specific sites and pull the version number of specific software.

This repo does that action and pushes the data into a faunaDB database, ready for the Gatsby website (built on netlify) to consume that data.

The Github actions that generate small JSON files with the latest version number of that piece of software in it. Includes:

• Latest Release or Version number
• Link to the latest release
• Updated date.

These then populate the FaunaDB.

(back to top)

2.1. Built With

• FaunaDB
• Gatsby
• Netlify
• Github Actions

(back to top)

2.2. Installation

Not built to be installed. This is pulled from the deployment repository and used via the CI pipeline.

(back to top)

3. Usage

Methods of extraction:

3.1. Github Repo

Uses github actions to get the release number of a github repository

3.2. X-Ray

Web scrape using node.js library x-ray

• https://github.com/matthewmueller/x-ray
• https://www.npmjs.com/package/x-ray

4. Customising

Add more CI jobs.

(back to top)

5. Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue. Don't forget to give the project a star! Thanks again!

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

(back to top)

6. License

Distributed under the MIT License.

MIT License

Copyright (c) 2022 Andy Pearson

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

(back to top)

7. Contact

Author Link: https://github.com/IORoot

(back to top)