Welcome to Job Aggregator Web Project!

Project Overview

---

Video Demo: https://youtu.be/heSWT1qmxPo

---

Description

This is a website aggregator of job vacancies mainly focused on the Czech Republic. It is built using the Flask framework, which allows users to have secure personal accounts and navigate through various pages of the website. Initially, it offers users the option to log in or register for the website. After the authentication procedure, the main page is displayed, allowing users to search for jobs of their interest in their preferred location. Additionally, users can select from which websites they want to see vacancies.

The jobs are scraped from 5 different websites:

• LinkedIn.com
• Indeed.com
• Startupjobs.cz
• Jobs.cz
• Prace.cz

After the search procedure begins, the jobs are dynamically added to the pages as they are scraped. Each job card contains information about the job title, company name, location, the date it was published, and salary if available. Additionally, users can sort the job listings based on their published date to see the most recent listings.

Users can add any job to their list of favorites. These can be found on the My Jobs page. There, for each job, different statuses can be set such as Interesting, Applied, Interview Scheduled, Offer Received, and Denied/No Answer. These favorite jobs, along with their statuses set by users, are stored in the database, so they are preserved even if a user logs out and subsequently comes back. Additionally, on the My Jobs page, users can filter jobs based on their statuses.

Declaration

The author does not intend to use the scraped data for commercial purposes or any similar activities. The goals of this project are purely educational.

Features

• User Authentication: Secure login and registration for users based on username and password. Passwords are stored in the database as hashes.
• Job Search: Search for jobs based on keywords and location.
• Website Selection: Choose specific websites among the 5 listed to scrape job listings from.
• Dynamic Job Listings: Jobs are fetched from the database first, then dynamically scraped and added to the page.
• Job Information: Each job card displays job title, company name, location, publication date, and salary (if available).
• Sorting: Sort job listings by their publication date.
• Favorites Management: Add and remove jobs from a list of favorites.
• Status Tracking: Set and track statuses for favorite jobs.
• Persistent Storage: Favorite jobs and statuses are stored in the database.
• Filtering: Filter favorite jobs based on their statuses.

Code Design

Run.py

This file runs the app.

Flask

• The Flask framework is used to develop the website.
• HTML pages are in app/templates/.
• Static files (CSS, JS, media) are in app/static/.
• Routes are defined in app/routes.py.
• app/__init__.py initializes the Flask app.
• Most routes are protected using @login_required.

Scrapy

• Scrapy is used for web scraping.
• Spiders are in jobscraper/jobscraper/spiders/.
• Scraped jobs are stored in the database.
• ScrapeOps middlewares are used to prevent detection.

Database

• MySQL is used.
• Tables:
  • users_logs: Stores user credentials.
  • jobs_active: Stores active job listings.
  • jobs_inactive: Stores old job listings.
  • favorite_jobs: Stores user favorite jobs.

Licence

This project is licensed and prohibits any distribution or commercial use. See the LICENCE file for details.