VisionFive Software v2.3.3

What's new

• Add NV21, I422, I444 YUV format for GStreamer and FFMPEG decoder(JPEG&MJPEG)
• Add YUV format/ROI/rotation/scale functions for JPU decoder
  • YUV format: NV12, NV21, I420, I422, I444;
  • ROI crop;
  • Rotation: 90°, 180°, 270°
  • Mirror: H-flip / V-flip / H&V-flip
  • Scale-down: 1/2, 1/4, 1/8;
• Bug fix;

Known Issues

• Remote login fails by SSH in TF card rootfs image
  • workaround: execute dropbear -R -E in serial terminal
• Error(Makefile 498 line) is reported during the first TF card burning operation
  • workaround: execute again until successful
• The screen still display the last image after excute gst-launch-1.0 with kmssink to play video or image
  • workaround: limitation on JH7100 as it only supports one crtc
• Video is about one second slower than audio when play video files(.avi)

VisionFive Software v2.3.0

What's new

• Device Tree overlay;
• JPEG and MJPEG decoding
• GStreamer using omxmjpegdec plug-in to decode video and picture;
• FFMPEG using mjpeg_omx pulg-in to decode video and picture;
• omx-il library and unit test for JPU decoder;
• omx-il unit test for video encode and decode (video_enc_test, video_dec_test);
• 8K/16k/22.05k/32k/44.1k/48k sample audio for PWMDAC;

Known Issues

• Remote login fails by SSH in TF card rootfs image
  • workaround: execute dropbear -R -E in serial terminal
• Error(Makefile 498 line) is reported during the first TF card burning operation
  • workaround: execute again until successful
• The screen still display the last image after excute gst-launch-1.0 with kmssink to play video or image
  • workaround: limitation on JH7100 as it only supports one crtc
• Video is about one second slower than audio when play video files(.avi)
• The system will halted when excute ffmpeg to transcode with h264_omx or hevc_omx
• The video will occasionally get stuck when excute gst-launch-1.0 with v4l2src & kmssink to play UVC

VisionFive Software v2.1.1

What's new

• Bug fix: TF card compatibility issue;

VisionFive Software v2.1.0

What's new

• Upgrade the kernel to 5.15.11;
• Upgrade the u-boot to 2022.04-rc2;
• Support clock tree and reset framework to VPU/V4L2/ALSA;
• Support NV12, NV21, I420 video format for FFMPEG;
• Support bitrate setting for GStreamer and FFMPEG;
• Support opus and midi format for audio encoding and decoding;
• Support NVDLA driver;

Known Issues

• Remote login fails by SSH in TF card rootfs image
  • workaround: execute dropbear -R -E in serial terminal
• Error(Makefile 498 line) is reported during the first TF card burning operation
  • workaround: execute again until successful
• The screen still display the last image after excute gst-launch-1.0 with kmssink to play video or image
  • workaround: limitation on JH7100 as it only supports one crtc
• Background noise is generated during playing audio through 3.5mm audio jack on the board
• Video is about one second slower than audio when play video files(.avi)
• The system will halted when excute ffmpeg to transcode with h264_omx or hevc_omx
• The video will occasionally get stuck when excute gst-launch-1.0 with v4l2src & kmssink to play UVC
• Lots of 'broken' lines appear on the screen when play the encode file which is generated by gst-launch-1.0 with v4l2src & omxh264enc

VisionFive Software v2.0.0

What's new

• VPU Encoding (H.264&H.265);
• Multimedia framework: FFMPEG
  • Using V4L2 input plug-in to get video;
  • Using ALSA input & output plug-in to record & play audio;
  • Using h264_omx / h265_omx hard decoding & encoding plug-in;
  • Supply FFMPEG Automated Testing Environment （FATE）
• Multimedia framework: GStreamer
  • Plug-ins: libcamerasrc, kmssink, omxh264enc, omxh265enc
• Display framework: DRM
  • Using standard DRM interface or libdrm library to display videos and pictures;
  • Support GStreamer framework to display videos and pictures using kmssink plug-in;
• Libcamera

Test Tools

• libcamera: cam, libcamera-apps
• FFMPEG: ffmpeg, ffprobe
• DRM: modetest, modeset

Known Issues

• Remote login fails by SSH in TF card rootfs image
  • workaround: execute dropbear -R -E in serial terminal
• Error(Makefile 498 line) is reported during the first TF card burning operation
  • workaround: execute again until successful
• The screen still display the last image after excute gst-launch-1.0 with kmssink to play video or image
  • workaround: limitation on JH7100 as it only supports one crtc
• Background noise is generated during playing audio through 3.5mm audio jack on the board
• Video is about one second slower than audio when play video files(.avi)
• The system will halted when excute ffmpeg to transcode with h264_omx or hevc_omx
• The playback time of h265 file on the board is too short, however the playback time on PC is normal
• The system will get stuck at 2.1s when encoding audio(alsasrc) & video(filesrc)
• The system will get stuck when excute gst-launch-1.0 with libcamerasrc & x264enc to encode video
• The video will occasionally get stuck when excute gst-launch-1.0 with v4l2src & kmssink to play UVC
• The UVC camera cannot be played after excute gst-launch-1.0 with libcamerasrc to kmssink or filesink alternately
• The video is finished earlier than audio when excute gst-launch-1.0 to play video & audio file which is generated by gst-launch-1.0 wit v4l2src & alsasrc & omxh264enc plug-in
• The system will get stuck if doing record or play audio after excute gst- launch-1.0 with kmssink to play video
• Lots of 'broken' lines appear on the screen when play the encode file which is generated by gst-launch-1.0 with v4l2src & omxh264enc

multimedia_v1.0.0.20211016

Features

• Audio: support asla driver framework for WM8960, AC108, pwmdac, spdif, vad, pdm
• Video Capture:
  • Support V4L2 driver framework for DVP, MIPI-CSI, VIN, ISP;
  • Support DVP and MIPI-CSI sensor: imx219, ov4689, dvp ov5640, sc2235;
  • Support UVC camera;
• Display: framebuffer
• VPU: decoding H.264(baseline/main/high profile) & H.265(main/main10 profile), scaler
• Multimedia framework: GStreamer
  • Support plugins list:
    • XXXSource：filesrc, v4l2src, alsasrc, ...;
      XXXSink: filesink, fbdevsink, alsasink, ...;
      demuxers： qtdemux, matroskademux, oggdemux, avidemux, ...;
      muxers：qtmux, oggmux, mp4mux, ...;
      parsers：oggparse, amrparse, aacparse, ...;
      decoder: omxh264dec, omxh265dec, Vorbisdec, avdec_h265, videoscale, ...;
      encoder: x264enc, avenc_aac, pngenc;
      others：audioconvert, videoconvert, videoscale, videorate, audiorate, capsfilter, playbin, decodebin, queue, ...;
  • Add StarFive private packages:
    • v4l2_test: test v4l2 device;
    • pp_test: convert color format and resolution for framebuffer framework;
    • sf-gst-omx: derivate from gst-omx and compatible with the omx-il library;
    • sf-omx-il: StarFive openmax il library for VPU hardware decode;
    • stfisp_setfile: host build package and generate isp register setting binary for v4l2;
    • wave511: hardware decode code building;
  • Add the following gstreamer patch:
    • Support gstreamer plugin fbdevsink NV12 format;
    • Support gst-play take priority to decode h264/h265 with gst-omx plugin;

Test Tools

• ALSA: aplay, arecord
• V4L2: media-ctl, v4l2-compliance, v4l2-ctl, v4l2test
• GStreamer: gst-play-1.0, gst-launch-1.0

Known Issues

• Remote login fails by SSH in TF card rootfs image;
  • workaround: execute dropbear -R -E in serial terminal;
• Error(Makefile 498 line) is reported during the first TF card burning operation;
  • workaround: execute the second time to burn it successfully;
• The picture is faulted when using v4l2-ctl tool to test pattern 3 (color bar with grey);
• When the serial port and SSH terminal capture video using video1 at the same time, the system will prompt the device BUSY, but the screen is black;
• Report oops when PWMDAC plays dual-channel audio after playing mono-audio by aplay;
• Error information is reported when capturing 4K or 2K pictures by gst-launch-1.0;
• Background noise is generated during playing sound by aplay;
  • workaround: change power source to regulated power supply;
• Lots of 'broken' line on the screen when playing video since display drive is based on fbdev;
• It can play up to 1080p@18fps or 720p@30fps videos as performance limitation of memcpy;
• It only supports NV12 format video for fbdevsink;
• System will be halt when playing audio on expansion board (AC108 and WM8960);