page.title=Audio and Video @jd:body

Quickview

In this document

  1. Audio and Video Playback
    1. Playing from a Raw Resource
    2. Playing from a File or Stream
    3. Playing JET Content
  2. Audio Capture

Key classes

  1. {@link android.media.MediaPlayer MediaPlayer}
  2. {@link android.media.MediaRecorder MediaRecorder}
  3. {@link android.media.JetPlayer JetPlayer}
  4. {@link android.media.SoundPool SoundPool}

See also

  1. Data Storage
  2. JetCreator User Manual

The Android platform offers built-in encoding/decoding for a variety of common media types, so that you can easily integrate audio, video, and images into your applications. Accessing the platform's media capabilities is fairly straightforward — you do so using the same intents and activities mechanism that the rest of Android uses.

Android lets you play audio and video from several types of data sources. You can play audio or video from media files stored in the application's resources (raw resources), from standalone files in the filesystem, or from a data stream arriving over a network connection. To play audio or video from your application, use the {@link android.media.MediaPlayer} class.

The platform also lets you record audio and video, where supported by the mobile device hardware. To record audio or video, use the {@link android.media.MediaRecorder} class. Note that the emulator doesn't have hardware to capture audio or video, but actual mobile devices are likely to provide these capabilities, accessible through the MediaRecorder class.

For a list of media formats for which Android offers built-in support, see the Android Media Formats appendix.

Audio and Video Playback

Media can be played from anywhere: from a raw resource, from a file from the system, or from an available network (URL).

You can play back the audio data only to the standard output device; currently, that is the mobile device speaker or Bluetooth headset. You cannot play sound files in the conversation audio.

Playing from a Raw Resource

Perhaps the most common thing to want to do is play back media (notably sound) within your own applications. Doing this is easy:

  1. Put the sound (or other media resource) file into the res/raw folder of your project, where the Eclipse plugin (or aapt) will find it and make it into a resource that can be referenced from your R class
  2. Create an instance of MediaPlayer, referencing that resource using {@link android.media.MediaPlayer#create MediaPlayer.create}, and then call {@link android.media.MediaPlayer#start() start()} on the instance:
    MediaPlayer mp = MediaPlayer.create(context, R.raw.sound_file_1);
    mp.start();

To stop playback, call {@link android.media.MediaPlayer#stop() stop()}. If you wish to later replay the media, then you must {@link android.media.MediaPlayer#reset() reset()} and {@link android.media.MediaPlayer#prepare() prepare()} the MediaPlayer object before calling {@link android.media.MediaPlayer#start() start()} again. (create() calls prepare() the first time.)

To pause playback, call {@link android.media.MediaPlayer#pause() pause()}. Resume playback from where you paused with {@link android.media.MediaPlayer#start() start()}.

Playing from a File or Stream

You can play back media files from the filesystem or a web URL:

  1. Create an instance of the MediaPlayer using new
  2. Call {@link android.media.MediaPlayer#setDataSource setDataSource()} with a String containing the path (local filesystem or URL) to the file you want to play
  3. First {@link android.media.MediaPlayer#prepare prepare()} then {@link android.media.MediaPlayer#start() start()} on the instance:
    MediaPlayer mp = new MediaPlayer();
    mp.setDataSource(PATH_TO_FILE);
    mp.prepare();
    mp.start();

{@link android.media.MediaPlayer#stop() stop()} and {@link android.media.MediaPlayer#pause() pause()} work the same as discussed above.

Note: It is possible that mp could be null, so good code should null check after the new. Also, IllegalArgumentException and IOException either need to be caught or passed on when using setDataSource(), since the file you are referencing may not exist.

Note: If you're passing a URL to an online media file, the file must be capable of progressive download.

Playing JET content

The Android platform includes a JET engine that lets you add interactive playback of JET audio content in your applications. You can create JET content for interactive playback using the JetCreator authoring application that ships with the SDK. To play and manage JET content from your application, use the {@link android.media.JetPlayer JetPlayer} class.

For a description of JET concepts and instructions on how to use the JetCreator authoring tool, see the JetCreator User Manual. The tool is available fully-featured on the OS X and Windows platforms and the Linux version supports all the content creation features, but not the auditioning of the imported assets.

Here's an example of how to set up JET playback from a .jet file stored on the SD card:

JetPlayer myJet = JetPlayer.getJetPlayer();
myJet.loadJetFile("/sdcard/level1.jet");
byte segmentId = 0;

// queue segment 5, repeat once, use General MIDI, transpose by -1 octave
myJet.queueJetSegment(5, -1, 1, -1, 0, segmentId++);
// queue segment 2
myJet.queueJetSegment(2, -1, 0, 0, 0, segmentId++);

myJet.play();

The SDK includes an example application — JetBoy — that shows how to use {@link android.media.JetPlayer JetPlayer} to create an interactive music soundtrack in your game. It also illustrates how to use JET events to synchronize music and game logic. The application is located at <sdk>/platforms/android-1.5/samples/JetBoy.

Audio Capture

Audio capture from the device is a bit more complicated than audio/video playback, but still fairly simple:

  1. Create a new instance of {@link android.media.MediaRecorder android.media.MediaRecorder} using new
  2. Create a new instance of {@link android.content.ContentValues android.content.ContentValues} and put in some standard properties like TITLE, TIMESTAMP, and the all important MIME_TYPE
  3. Create a file path for the data to go to (you can use {@link android.content.ContentResolver android.content.ContentResolver} to create an entry in the Content database and get it to assign a path automatically which you can then use)
  4. Set the audio source using {@link android.media.MediaRecorder#setAudioSource MediaRecorder.setAudioSource()}. You will probably want to use MediaRecorder.AudioSource.MIC
  5. Set output file format using {@link android.media.MediaRecorder#setOutputFormat MediaRecorder.setOutputFormat()}
  6. Set the audio encoder using {@link android.media.MediaRecorder#setAudioEncoder MediaRecorder.setAudioEncoder()}
  7. Call {@link android.media.MediaRecorder#prepare prepare()} on the MediaRecorder instance.
  8. To start audio capture, call {@link android.media.MediaRecorder#start start()}.
  9. To stop audio capture, call {@link android.media.MediaRecorder#stop stop()}.
  10. When you are done with the MediaRecorder instance, call {@link android.media.MediaRecorder#release release()} on it.

Example: Audio Capture Setup and Start

The example below illustrates how to set up, then start audio capture.

    recorder = new MediaRecorder();
    ContentValues values = new ContentValues(3);

    values.put(MediaStore.MediaColumns.TITLE, SOME_NAME_HERE);
    values.put(MediaStore.MediaColumns.TIMESTAMP, System.currentTimeMillis());
    values.put(MediaStore.MediaColumns.MIME_TYPE, recorder.getMimeContentType());
    
    ContentResolver contentResolver = new ContentResolver();
    
    Uri base = MediaStore.Audio.INTERNAL_CONTENT_URI;
    Uri newUri = contentResolver.insert(base, values);
    
    if (newUri == null) {
        // need to handle exception here - we were not able to create a new
        // content entry
    }
    
    String path = contentResolver.getDataFilePath(newUri);

    // could use setPreviewDisplay() to display a preview to suitable View here
    
    recorder.setAudioSource(MediaRecorder.AudioSource.MIC);
    recorder.setOutputFormat(MediaRecorder.OutputFormat.THREE_GPP);
    recorder.setAudioEncoder(MediaRecorder.AudioEncoder.AMR_NB);
    recorder.setOutputFile(path);
    
    recorder.prepare();
    recorder.start();

Stop Recording

Based on the example above, here's how you would stop audio capture.

    recorder.stop();
    recorder.release();