current position:Home>Fusion communication FAQ | 7 issue of the cloud small classroom

Fusion communication FAQ | 7 issue of the cloud small classroom

2022-08-06 09:32:20NetEase Yunxin

2ed7277e26c4e78182afb280714391f7.png

2022.07

031d8cac3ac82b66eb6722b46b8df189.png

「融合通信常见问题」将在每月与大家见面,该月刊主要包括错题集、知识加油站、技术加餐三大板块,汇集实践过程中的易错问题和解题思路,分享融合通信领域的前沿资讯和技术干货,为您的开发提效加速,为您的进阶之路添砖加瓦.

outside_default.png

本期内容概览

看这里!别人踩过的坑快避开

1. iOS end if video capture is turned off on one end,The canvas on the other end has nothing to show,Android will display the last frame of the picture.

2. After the peer hangs up,The end did not hang up

3. 华为 pad 调用 switchdevice 切换摄像头,The rear camera failed to open

4. Cause occasional crashes and user information read and write exceptions(The user or group information cannot be obtained)

5. Causes the login to fail,No callbacks or whatever sdk Method call failure problem

6. Get a list of sessions after disconnecting and reconnecting,The number of sessions decreases

这些知识点你知道吗?

1. 实时音视频 2.0 Which scenarios are supported?

2. 为什么打开摄像头失败?

这些干货也不容错过!

1. Sanitizers 系列之 address sanitizer 用法篇

2. 超分辨率技术在实时音视频领域的研究与实践

3. 沉浸式体验网易云信在线 KTV

outside_default.png

01.

错题集

d070e2be428d6ba2f309ac6c670335b5.jpeg

■ 音视频通话

疑难问题 1:

iOS end if video capture is turned off on one end,The canvas on the other end has nothing to show,Android will display the last frame of the picture.

  • 易错等级

  • 错题原因

    The cleaning logic for the canvas push screen,Android is left to the user to clean up,iOS 是 sdk automatically cleaned.

  • 解题思路

    For scenarios where video capture is turned off at one end,The best practice is to add a placeholder image to the canvas on the other end,Prompt the user that the current peer has left(Video capture is turned off).The canvas doesn't show any hints just a blank view and display the last frame(Looks like Caton)都不友好.

疑难问题 2

After the peer hangs up,The end did not hang up

  • 易错等级:

  • 错题原因:

    iOS 和 web The end is not currently availableUI界面,sdk The hangup operation will not be automatically processed after receiving the notification of the peer hangup.

  • 解题思路:

    iOS 和 web The end can receive the callback that the peer end hangs up,The business layer can actively call the hang-up method to perform the hang-up operation,And hide the call page.

疑难问题 3:

华为 pad 调用 switchdevice 切换摄像头,The rear camera failed to open

  • 易错等级

  • 错题原因

    Android pad/Switching camera devices on the phone reports an error  could not start video source 的报错,Indicates that the browser is not allowed to have two cameras open at the same time on the device

  • 解题思路

    It can be done by calling first close 关闭,再 open Open way to circumvent,不使用 switchdevice.

■ IM 即时通讯

疑难问题 4:

Cause occasional crashes and user information read and write exceptions(The user or group information cannot be obtained)

  • 易错等级:

  • 错题原因

    sdk 的 document Read and write operations are currently only supported on the main thread,There may be threading issues when calling from a child thread

  • 解题思路:

    The amount of read and write data for user information and group information is relatively small,The time-consuming acquisition of user information or group information can be ignored,Information can be obtained directly from the main thread call.

疑难问题 5:

Causes the login to fail,No callbacks or whatever sdk Method call failure problem

  • 易错等级

  • 错题原因

    IM sdk 会启动一个子进程,Retriggered when the child process starts Application#onCreate 的调用,If no process judgment is added, other third-party libraries will be additionally initialized once.At this time, it is possible that other third-party libraries will crash,cause this problem.And that child process is IM exclusive process,There is no need to initialize other third-party libraries,This results in unnecessary memory waste and unexpected situations.

  • 解题思路:

    在 Application#onCreate Add process judgment in ,IM No other third-party libraries are initialized when the process starts.

疑难问题 6:

Get a list of sessions after disconnecting and reconnecting,The number of sessions decreases

  • 易错等级

  • 错题原因

    SDK The design is if there is a roaming timestamp in local memory,That is, if you have logged in before Logging in again only syncs incremental data(Mainly to reduce the pressure on the server),So for the client it looks like onsessions The callback returned fewer sessions

  • 解题思路:

    1、用户调用 disconnet 之后 destroy 下,Then reinitialize the instance,In this way, you can get the complete recent session by reconnecting again.

    2、After the local first triggers the callback to get the session,Keep a copy for business,After the incremental session is obtained again, it is added to the original session data.

02.

知识加油站

aee2af750a0de0662ec919e26de68791.jpeg

1. 实时音视频 2.0 Which scenarios are supported?

实时音视频 2.0 支持场景多样,Including but not limited to music teaching、语音通话、视频社交、在线课堂、远程问诊、音乐互动课堂、Anchor interactive live broadcast,You can also combine audio and video calls according to your business form 2.0 Powerful audio and video capabilities produce more application scenarios.

2. 为什么打开摄像头失败?

摄像头打开失败有多种原因,您可以参考如下步骤进行排查:

  • 确认摄像头权限有没有打开.Android、iOS/macOS 系统都有权限管理,请在系统设置中检查.同时 Android 上有些安全软件也管理权限.

  • 检查是否有其他应用占据了摄像头.关闭其他应用,重启手机再试.

  • 摄像头硬件问题.打开系统自带的拍摄视频程序看是否可以录像.

03.

技术加餐

459b6d8de233a9cd89bfcd2188f41bb2.jpeg

点击文章名称即可跳转

1. Sanitizers 系列之 leak sanitizer 介绍

  • 内容概述:A memory leak is a common memory error,本文介绍用于检测这类错误的 Sanitizer: LeakSanitizer(简称 lsan),本文将介绍 lsan 的用法、principles and accuracy.

2. 超分辨率技术在实时音视频领域的研究与实践

  • 内容概述:网易云信音视频实验室取得 NTIRE 高效率超分辨率挑战赛总体性能赛道冠军,以及运行时间赛道季军.本文将着眼于 AI 超分技术从研究到部署的落地问题,介绍超分辨率技术现状,以及视频超分在移动端落地应用所面临的机遇与挑战.

3. 沉浸式体验网易云信在线 KTV

  • 内容概述:在防疫常态化的当下,越来越多的线下娱乐活动被线上产品所取代.线上 KTV 受到了众多用户的喜欢,但要达到线下 KTV 式的沉浸式体验,提供音频体验的厂商们还面对诸多的挑战,尤其是在实时合唱方面,还有许多技术难题需要解决.This article will be based on the practical experience of NetEase Yunxin,分享网易云信在实时合唱技术方面所做的努力以及现有成果.

END

396f67670c15b4ce8bffad107e56cb24.gif

「云信小课堂」推荐阅读

接入指南

音视频通话 | 构建本土「Clubhouse」

安卓端 PK 连麦 | iOS 端 PK 连麦

在线聊天室 | 聊天室内容审核

利用 UI 组件实现应用级别在线聊天室

协同办公系统 | 音视频安全检测

a3081085d72261532f111b8b5f2d0ece.gif

79cbdd80589f844ad06a08067b8afe44.gif

关于网易云信

网易云信是集网易 20 余年 IM 以及音视频技术打造的融合通信云服务专家,稳定易用的通信与视频 PaaS 平台.

提供融合通信与视频的核心能力与组件,包含 IM 即时通讯、5G 消息平台、一键登录、信令、短信与号码隐私保护等通信服务,音视频通话、直播、点播、互动直播与互动白板等音视频服务,视频会议等组件服务.

网易云信服务于网易云音乐、好未来、新东方、科大讯飞、南京银行等各行各业客户.

4313b43e4ce6164fb2123d0853be2be6.gif

8e4d061edc09d5da585142e2f821cbf9.gif

8b7220e25fe8d01d59b988aec367dd88.png

copyright notice
author[NetEase Yunxin],Please bring the original link to reprint, thank you.
https://en.chowdera.com/2022/218/202208060915018443.html

Random recommended