Course about artificial intelligence applied to the arts. Available in spanish and english.

mathigatti mathigatti Last update: Jun 03, 2022

Art with AI

Are you interested in art? Are you curious about how new technological tools might help in your creative process? Then this is the course for you. In this class you are going to learn what Artificial Intelligence is and how to get your hands on practical and fun projects quickly.

How to use this material?

You can follow it in order or go straight to the Lectures that you find more interesting if you feel confident enough. If you are not familiar with Google Colab you might check first the Lecture 0 and some Youtube tutorials. In the links you will find all the materials of each class, [ES] stands for spanish and [EN] for english.

What I can do with this?

Check some cool projects from students that enrolled in the course here. You will find fake news twitter bots, poetry, made up pokemons and an old Freud singing.

Course syllabus

  • Lecture 0: Python & Colab intro [EN] [ES]

  • Lecture 1: Introduction [EN] [ES]

    • Machine learning overview and its role in the arts
    • Introduction to neural networks
      • History
      • Different architectures and their use cases
    • Introduction to the course tools
      • Python (And its machine learning and data analysis libraries)
      • Google Colab
  • Lecture 2: Text Generation

    • Text preprocessing [EN] [ES]
    • Text generation with GPT-2 [EN] [ES]
  • Lecture 3: Advanced text generation and musical composition [EN] [ES]

    • Music composition with GPT-2
    • Other relevant models
      • Fake news generator (CTRL)
      • Jukebox
  • Lecture 4: Voice synthesis with neural networks (dc_tts)

    • How to prepare the dataset to clone a voice [EN] [ES]
    • How to train a model to clone a voice [EN] [ES]
  • Lecture 5: Audio coding and synthesis [EN] [ES]

    • Spleeter: Separation of audio sources
    • Automatic transcription from audio to midi
    • GANSynth: Audio Synthesis
    • NSynth: Synthesis from samples [EN] [ES]
  • Lecture 6: Sampling & MIR (Music Information Retrieval) [ES]

    • Identification of beats and sections: wav2loops
    • Spleeter: Separation of audio sources
    • Automatic transcription: wav2midi
  • Lecture 7: Models for multimedia content [EN] [ES]

    • Singing synthesis models (Mellotron, Sinsy and vocaloid)
    • Image synthesis and editing
    • Video synthesis and composition

Support my work

If you want to help me to keep going developing and maintaining open-source projects you can contribute buying me some ko-fi.

License

MIT

Subscribe to our newsletter