video lag during screen sharing (and call)

Scenario:

• do call between 2 participants
• participant A on linux qt, other participant B shares his screen
• after few minutes, there is a delay in the video seen by A (no audio delay)

assigned to @atraczyk

Video lag increases if you use a virtual camera (OBS Studio).

An interesting test:

screen-share your games (using Jami,the “Screen Sharing” option)

screen-share your games (using OBS Studio)

both times: the video starts lagging

OS: Windows 10

for your use case you probably need to check if your whole pipeline is hardware accelerated. In obs and Jami, else your CPU will be a bottleneck

something similar: https://git.jami.net/savoirfairelinux/ring-client-android/-/issues/922

Windows 10, Jami (newest version): one thing I've noticed: If you share your screen the first time (webpage) you have a video lag. The second time you share your screen again there is less delay in the video.

"hardware acceleration" is enabled (Jami)

another issue:

1. You start Jami (video call)
2. Now you share your screen
3. You start a video game
4. If I want to return to Jami I press Ctrl-Alt-Del so I open the Windows Task Manager
5. Now I am back (Jami)

BUT: The the screen sharing is frozen

I need to select a camera again and share the screen another time if I want to continue

same issue if you use a virtual webcam: OBS-VirtualCam (you only see a black screen after you open the windows task manager)

(Video lag:) I think its not because of the hardware acceleration ... but maybe you can try it out. (good internet speed)

using Jami (Windows 10, newest update): the issue still persists AND it's even worse than before. massive lag (good Internet connection)

mentioned in issue #390

added SprintIn progress label

unassigned @atraczyk

changed title from video lag during screen sharing to video lag during screen sharing (and call)

I think if you share only a small portion of your screen the lag is reduced (a little bit).

OS: Windows 10, using newest version of Jami

#403

using newest version of Jami (Windows 10): "after few minutes, there is a delay in the video seen" confirmed BUT I've seen the dalay after a few 10 seconds. (second device: Android) #403

Actually there are two issues:

Windows 10: video lag starting at the beginning of the video call and going on (seen on the screen of the smartphone)

Android: no video lag at the beginning of the video call - BUT after a few 10 seconds (seen on the screen of your pc monitor)

It would be great if you were able to test this issues with different video resolutions and different frames per second (Person A (Full-Hd,60fps; Person B (HD, 30 fps), and even Person C(4k, 60 fps) etc,) and all using different connection speed (good internet speed and slow internet connection)

mentioned in issue #446 (closed)

ok - to aviod duplicates: I just want to mention the sound (sound output of the PC (using microphone "your loudspeaker")) might be affected too.

good internet speed: the video lag (screenshare) is reduced

slow: connection speed measured: 0,5 Mbps (upload)

fast: connection speed measured: 6-7 Mbps (upload)

I did another test: using Bluestacks 4 (windows 10) with a slow Internet connection (0,5 Mbps upload speed): other device: mate 20 pro (fast Internet connection)

ALWAYS same slow internet connection:

Threema: no video lag

Jami (Android, Device 1: Bluestacks 4, Device 2: mate 20 Pro ): no video lag

---

just windows 10 (no emulator): video lag

using same hardware, but fast internet connection:

Jami (Windows 10): video lag during screen sharing is reduced

BUT

Webcam: still 2 seconds video delay

again, try with hardware decoding/encoding OFF not on.

Sorry for posting that many details. May I ask where I can turn "hardware decoding/encoding" off? I only see the option "hardware acceleration on/off" ( I didn't find anything here: https://jami.net/hardware-accelerated-encoding-and-decoding-in-jami/ )

Or do I have to change computer's basic settings?

the hardware acceleration off will disable the two settings.

For more control there is the "dring.yml" file (cf https://git.jami.net/savoirfairelinux/ring-project/-/wikis/tutorials/Frequently-Asked-Questions#where-are-the-configuration-files-located) where you have two separate settings

Thanks for your reply.

just tried out: a little less laggy

However still 1-2 seconds delay (same hardware (settings) used).

removed SprintIn progress label

changed milestone to %Backlog

It also takes a few seconds until you can switch between webcam and screen share (lag).

EDIT: Person A (Windows 10, newest version of Jami) and Person B (Android Tablet):

"normal" screen sharing (no virtual camera used): Person B notices 2-3 seconds of video delay.

Person A (LTE): Ping: 17 ms | Download speed: 34 Mbps | Upload Speed: 10 Mbps

Person B: Ping: 16 ms Download speed: 7 Mbps | Upload Speed: 0,9 Mbps

AND: Sometimes the video (Person B that can view my screen from a tablet) is stuck for a few seconds (video game) but then everything works again.

mentioned in issue #514 (closed)

mentioned in issue #541 (closed)

mentioned in issue jami-project#1294 (closed)

closed