Python
  • Blog
  • Contact
    • Overview
    Issues 9

    :newspaper: Let ChatGPT Summarize Hacker News for You

    polyrabbit polyrabbit Last update: Dec 26, 2023

    Let ChatGPT Summarize Hacker News for You

    Github Pages license PRs Welcome Hacker News

    中文版

    Hacker News Summary leverages AI technology to extract summaries and illustrations from Hacker News articles, providing a seamless news scanning experience.

    Summaries are primarily generated by ChatGPT gpt-3.5-turbo model, and fallback to local GoogleT5 model when ChatGPT is not available.

    Features

    • Clear and easily understandable summaries generated by our advanced AI assistant
    • Relevant illustrations make articles easily scannable and visually engaging
    • Common video sites, PDFs, and GitHub gists are seamlessly embedded
    • Flexibility to sort articles based on their points, comment count, or publication time
    • Filter the topN articles based on their points.
    • RSS feeds fully supported (#14, #19)
    • Local translation (Chinese)

    Talk is cheap, show me the screenshot!

    hn-summary

    Emoji explained:

    • ❤️: point - upvotes received from the Hacker News community
    • 👤: user - Hacker News user who submitted this post
    • 🕘: submission time - a human-readable time indicating when the post was submitted
    • 💬: comment count - comments posted by the community, click to visit this comment page
    • 🔗: source of the news - where the news originated
    • 📰: summary model - which model is used to generate the summary, options are OpenAI, GoogleT5 and Prefix

    How it works

    Hacker News Summary is a static site hosted on GitHub Pages. It performs the following periodic actions:

    1. Parsing the Hacker News page to obtain a list of news articles
    2. Extracting the main content from each news article using a score algorithm
    3. Finding the most suitable illustration for each article and making a local copy
    4. Generating summaries of the article's content using OpenAI API or invoking a local model as a fallback when the API is unavailable
    5. Rendering a template that incorporates the illustrations and summaries, and deploying it to GitHub Pages

    Localization

    Translation is also performed by ChatGPT, with a single extra step in the prompt. Currently supported languages:

    TODO

    • A better way to scrap websites (maybe PhantomJS & Selenium)
    • Also summarize comments (see discussions on Hacker News)
    • Switch to Hacker News API
    • A more beautiful home page (maybe in HTML9)
    • Discover an alternative local models for generating summaries
    • Sort articles by points/comments/time
    • Filter topN articles by points
    • RSS
    • Deploy on github pages
    • Have a good sleep !important
    Tags:

    Owner

    polyrabbit

    polyrabbit
    GitHub Repository https://github.com/polyrabbit
    Umami Analytics Client for Python

    See the usage example below for the Python API around these features. Enjoy.

    mikeckennedy
    51 Apr 18, 2024
    New generation opensource data stack

    This repository contains Docker compose script that creates opensource data analytics stack on your local machine. Currently, the stack consists of multiple components: I plan to add more components …

    zsvoboda
    52 Apr 12, 2024
    Climate Analytics using Deep Neural Networks in Python.

    ClimateNet is a Python library for deep learning-based Climate Science. It provides tools for quick detection and tracking of extreme weather events. We also expose models, data sets and metrics to j…

    andregraubner
    53 Apr 17, 2024
    The purpose of this repository is to make it as easy as possible to develop and use awesome Panel extensions.

    We want to We provide You can install and use the package as simple as. Explore the sample apps Click one of the buttons Thanks I would love to support and receive your contributions. Thanks.

    awesome-panel
    54 Apr 16, 2024
    This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging the data, filling the data warehouse, and running checks on the data quality as the final step. Automate the ETL pipeline and creation of data warehouse using Apache Airflow. Skills include: Using Airflow to automate ETL pipelines using Airflow, Python, Amazon Redshift. Writing custom operators to perform tasks such as staging data, filling the data warehouse, and validation through data quality checks. Transforming data from various sources into a star schema optimized for the analytics team’s use cases. Technologies used: Apache Airflow, S3, Amazon Redshift, Python.

    For this project, I have build four different operators that will stage the data, transform the data, and run checks on data quality. You will also need to have software installed to run and execute …

    ddgope
    57 Apr 25, 2024
    Utility functions for "Data Mining for Business Analytics: Concepts, Techniques, and Applications in Python"

    Collection of utility functions used in the book Should this not work, for example when you are behind a firewall, download the package from pypi and install from file, e.g. Adjust the link as requir…

    gedeck
    58 Apr 25, 2024
    :earth_americas: Analyze and generate reports of web logs (NGINX)

    Lala is a Python library for access log analysis. It provides a set of methods to retrieve, parse and analyze access logs (only from NGINX for now), and makes it easy to plot geo-localization or time…

    Edinburgh-Genome-Foundry
    60 Jun 20, 2023
    Exploratory data analysis projects on Different datasets to enhance Data Analysis and visualization
    shsarv
    61 Apr 07, 2024
    A simple package to abstract away the process of creating usable DataFrames for data analytics. This package is heavily inspired by the amazing Python library, Pandas.

    A simple package to abstract away the process of creating usable DataFrames for data analytics. This package is heavily inspired by the amazing Python library, Pandas. Utilize the CreateDataFrame fun…

    kfultz07
    63 Apr 26, 2024
    A python project starter template for data-analytics and data-science.

    A project template to quick start data analytics and machine learning task. You can connect with me here:

    janishar
    70 Apr 01, 2024

    Subscribe to our newsletter