Listening Future Technology
Project Overview
-
The LFT project emerges from the intersection of AI and music, addressing a growing trend of amateur creators interested in songwriting and music composition. The initiative recognizes the barriers faced by non-professionals, such as lack of technical expertise, and leverages AI to democratize music creation. By analyzing user-generated content like diaries and leveraging advanced AI models, the project seeks to inspire creative expression in an accessible way.
-
Lyrics Generation: Using GPT-3.5 for diary text analysis, emotion detection, and lyric creation based on user input.
Music Composition: A generative AI-powered system creates melodies tailored to user-selected keywords, offering personalized soundtracks.
Interactive Prototyping: Users interact with a streamlined platform that guides them through selecting genres, moods, and themes to generate complete songs. These features make music creation intuitive and enjoyable for non-experts.
-
Generative AI: OpenAI’s GPT-3.5 for text analysis and lyric creation, and Jukebox for music generation.
Computer Vision: Google Cloud Vision for text detection in diary entries.
Data Analysis: Emotion and stylistic analysis of user inputs to personalize outputs. This robust tech stack ensures the system’s scalability and responsiveness.
-
Social Media Content Creation: Tailored music for short-form videos.
Webtoon and Digital Art: Background music that complements visual storytelling.
Personal Projects: Custom soundtracks based on daily reflections or themes. These use cases demonstrate LFT’s versatility and its ability to meet varied creative needs.
Prototype Design
After submitting a diary entry, users are taken to the Lyrics Writing section, where the app processes their thoughts into tailored lyrics. Once the lyrics are generated, they are displayed for review, and users can revisit and manage past diary entries, neatly organized in a date-based list.
When users open the app, they can choose between Lyrics Writing, Music Composition, or Diary Writing. In Diary Writing, users record daily thoughts, which can later be transformed into personalized lyrics.
In the Music Composition section, users are introduced to LFT’s intuitive process for creating music. Users choose from a visually engaging web of keywords, reflecting themes or moods for their desired composition. The system then generates a custom melody based on these inputs.