AD SPACE AVAILABLE · BRAND PARTNERS WELCOME

How to Train Custom AI Voice Models on Voicify AI (Jammable) Using Clean Audio Samples

365Finds Editorial
Indexed 11,430 Wiki articles

Put 365 Wiki to work with your AI

Copy the prompt below, paste it into the AI you already use, then ask your question.

Download full Skill

Try it with the prompt first. If you use 365 Wiki often, install the full 365Wiki Skill so you do not have to paste it again. No regular AI? Gemini or Microsoft Copilot on the web will work.

365Wiki Skill

Content creators looking to produce signature AI music covers, virtual character narration, or personalized speech synthesis can train bespoke voice models directly on Jammable (formerly known as Voicify AI). While Jammable provides an automated, browser-based cloud pipeline that trains models in minutes, the ultimate quality of the synthesized voice depends heavily on the training data. Because Jammable's cloud system automatically handles feature extraction and pitch indexing without exposing manual hyperparameter controls, it cannot correct background noise, room reverb, or instrumental bleed. Uploading dirty audio bakes unwanted artifacts directly into the voice profile, resulting in metallic distortion, robotic warble, and erratic pitch tracking.

Achieving a clean, natural-sounding custom voice model requires a dedicated workflow: extracting isolated vocals with stem-separation software, conditioning the audio in digital editing tools, and deploying the dataset onto Jammable’s training infrastructure.


1. Prerequisites and Plan Requirements

Before preparing audio, creators need to select the appropriate access tier on Jammable:


2. Step 1: Preprocessing Clean Vocal Samples

The neural voice conversion architecture behind Jammable learns every acoustic artifact present in the training files. If a sample contains drum bleed, room echo, or a second singer's harmony, the trained model will attempt to reproduce those sounds whenever it sings or speaks. Creators should follow a three-phase preprocessing pipeline before uploading any audio.

Phase A: Source Audio Selection

Phase B: Vocal Stem Separation (Ultimate Vocal Remover / UVR5)

When pulling vocal samples from existing songs, video interviews, or podcast episodes, standard web converters often leave noticeable artifacts. Content creators rely on Ultimate Vocal Remover (UVR5), a free, open-source tool recognized as the benchmark for local stem separation:

  1. Extract Vocals: Load source audio files into UVR5. Select the MDX-Net processing engine (such as the Kim Vocal 1 or UVR-MDX-NET Main model) to isolate clean acapellas while discarding instrumental backing tracks, bass, and percussion.
  2. Remove Reverb and Echo: AI voice conversion models must be trained on completely "dry" vocals. If the source material contains room reflections or studio reverb, run the isolated vocal stem through UVR5’s VR Architecture using the De-Echo: Normal or De-Echo / De-Reverb models. Baking reverb into the model will make every future song or voiceover sound hollow and distant.

Phase C: Spectral Cleaning and Trimming in Audacity

Once stems are separated and dried, import them into an audio editor like Audacity (or a digital audio workstation such as Reaper or Adobe Audition) for structural cleanup:

  1. Cut Low-End Rumble: Apply a high-pass filter (cut off below 70–80 Hz with a 12 dB/octave slope) to eliminate air conditioner hum, microphone stand vibrations, and plosive thumps.
  2. Truncate Dead Air: Go to Effect > Truncate Silence in Audacity. Set the threshold to -40 dB and truncate silences longer than 0.5 seconds down to 0.2 seconds. Voice models train on vocal formants; long silent gaps waste training capacity.
  3. Manual De-Clicking and Editing: Zoom in on the waveform to delete loud gasps, throat clearing, coughs, laughter, and sharp mouth clicks.
  4. Gain Normalization: Normalize all audio clips to a consistent peak level (between -1.0 dB and -2.0 dB Peak) to avoid digital clipping while maintaining uniform volume throughout the dataset.
  5. Exporting: Export the cleaned dataset as lossless WAV files (16-bit or 24-bit PCM at 44.1 kHz or 48 kHz). Jammable also accepts high-bitrate MP3 and M4A files, but uncompressed WAV prevents cumulative lossy compression artifacts.

3. Step 2: Training the Custom Voice on Jammable

With an optimized dataset ready, creators can execute the cloud training process directly on the platform:

  1. Access the Training Studio: Log in to your Jammable account with an active Creator or Power subscription, then navigate to https://www.jammable.com/train (or click Create > Train a Voice in the top navigation).
  2. Upload Audio Files: Drag and drop your preprocessed WAV or MP3 files into the upload box.
  3. Verify Dataset Duration: Check the on-screen "Dataset Duration" gauge. Ensure the indicator passes the minimum mark and sits comfortably in the "Recommended" zone.
  4. Configure Model Profile:
    • Voice Name: Give the model a distinct, recognizable title.
    • Avatar Image: Upload an artwork or character portrait to identify the model in your dashboard.
    • Privacy Settings: Choose between Private and Public. Keeping the model private ensures only your account can generate audio with it—critical for personal voice clones, commercial branding, or exclusive character voices. Selecting public shares the model with Jammable’s global community.
  5. Initiate Training: Click Next Stage and confirm training. Jammable queues the dataset into its cloud cluster. The training process runs automatically, extracting acoustic timbre and pitch mappings within 2 to 10 minutes depending on server load.

4. Step 3: Testing, Tuning, and Producing AI Covers

Once Jammable marks the model as trained, creators can immediately deploy it inside the creation suite:

  1. Generate a Test AI Cover: Navigate to https://www.jammable.com/ai-cover. Select your newly trained custom model from your private library.
  2. Provide an Input Track: Upload a song audio file or select an available track. Jammable's internal engine splits the song's vocals, converts them into your custom voice, and mixes the converted vocal line back over the original instrumental.
  3. Adjust Pitch Transposition (Pitch Shift):
    • If converting a song sung by an artist with a vocal range significantly different from your model (e.g., converting a female soprano vocal to a male baritone custom model), adjust the pitch slider by -12 semitones (one full octave down).
    • Converting male vocals to a female custom model typically requires a +12 semitones octave shift. Failing to transpose cross-gender tracks causes unnatural pitch strain and raspy distortion.
  4. Generate Spoken Content: For YouTube commentary, voiceover narration, or podcast intros, navigate to Jammable's Text-to-Speech module, paste script copy, and generate natural spoken speech using the custom model.

5. Technical Comparison: Jammable Cloud vs. Self-Hosted Local Training

FactorJammable (Voicify AI) Custom VoiceSelf-Hosted RVC v2 / Applio (Local)
Setup & ComplexityZero setup; web-based GUI in browserComplex; requires Python, Git, CUDA, and dependencies
Hardware DemandsCloud-rendered; works on laptops & phonesDemands dedicated NVIDIA GPU (6GB+ VRAM minimum)
Training Speed2 to 10 minutes15 to 45 minutes depending on local GPU power
Parameter ControlAutomated convergence; no epoch or batch slidersFull control over epochs, sample rate, and pitch extractors (Crepe, Harvest, PM)
Built-in WorkflowInstant access to cover mixer, duets, and video exportManual stem separation, inference, and DAW mixing required
PricingCreator plan ($24.99/mo) or Voice PassesFree and open source (excluding local hardware costs)

6. Practical Takeaways and Best Practices

References