ABSTRACT
Auditory brainstem response (ABR) is widely employed to evaluate the hearing function, both in clinics and basic research. Despite many attempts for automation over decades, reliable determination of threshold stimulus level still relies on human visual identification of waveform, which oftentimes is subjective. Here, we report a robust procedure for automatic and accurate threshold determination in both mouse and human ABR. Contrary to prior approaches, in our new threshold determination algorithm, the on-going averaging is stopped once the waveform is confirmed by a cross-correlation time shift approach. The flexible ending sweep numbers for different stimuli is used to inform the threshold determination. We found a good match of the threshold readings between the algorithm and the human judges. Moreover, in the algorithm, smaller sweep number is required for strong response from supra-threshold level, and thus a considerable portion of sweeps can be saved in comparison to the case with level averaging of a fix number. These features are attractive and implementation of this method in commercial devices will make the ABR test procedure more objective and efficient.
INTRODUCTION
The auditory brainstem responses (ABRs) are brain electrical potential changes due to synchronous neuronal activities evoked by supra-threshold acoustic stimuli (Jewett et al., 1970). These responses are detectable using non-invasive surface electrodes placed on the scalp of the test subject, and thereby widely employed to assess the hearing function. In rodents and cats, typical ABR waveform is composed of initial five peaks in the early onset of sound evoked potentials, followed by broader, later waves that represent synchronous activities arising from projections along the auditory ascending pathway including auditory nerve, cochlear nucleus, superior olivary complex, lateral lemniscus and inferior colliculus, respectively (Henry, 1979; Melcher et al., 1996), whereas in human slightly different peak generators were demonstrated with intracranial recordings (Moller and Jannetta, 1983) and neuromagnetic responses (Parkkonen et al., 2009). Thus, features like ABR wave latencies and amplitudes provide clinical-significant information, for instance site of lesions or tumors in the auditory system (Lewis et al., 2015; Roeser et al., 2007) based on how the properties of waveforms are altered.
Although the ABR is an objective measurement, at near-threshold the waveform recognition involves human interpretation. Currently, professionals are still required to supervise recording and visually identify the obtained waveforms which is labor-intensive. Besides, such interpretations oftentimes are subjective and can introduce errors that vary from person to person. When bias due to the skill and the experience of the interpretators is involved, the variation is not trivial, especially for cases with untypical waveform or high background noise (Vidler and Parkert, 2004). As precise and objective measurement of small hearing threshold elevation became critical for diagnosis of progressive hearing loss (Barreira-Nielsen et al., 2016), hidden hearing loss (Kujawa and Liberman, 2009; Mehraei et al., 2016; Ridley et al., 2018; Sergeyenko et al., 2013), age-related hearing loss (Gates and Mills, 2005; Sergeyenko et al., 2013) and tinnitus (Bramhall et al., 2018; Castaneda et al., 2019), automated approaches with high precision and reliability are in demand to objectify the ABR threshold determination. Over decades, many attempts were made including: (1) quantification of the waveform similarity by comparison to existing templates (Davey et al., 2007; Elberling, 1979; Valderrama et al., 2014) as well as based on features learned by artificial neural network (Alpsan and Ozdamar, 1991; McKearney and MacKinnon, 2019) from human annotated datasets; (2) quantification of the waveform stability by cross-correlation function between single-sweeps (Bershad and Rockmore, 1974; Weber and Fletcher, 1980), interleaved responses (Berninger et al., 2014; Xu et al., 1995) or responses at adjacent stimulus levels (Suthakar and Liberman, 2019); (3) the ‘signal quality’ through scoring procedures like F-ratios (Cebulla et al., 2000; Don and Elberling, 1994; Elberling and Don, 1984; Sininger, 1993). Due to inconsistencies in waveform and signal-to-noise-ratio (SNR) introduced by differences in test subject conditions, electrode placement and impedance, as well as acquisition settings, the accurate threshold determination is only possible under a narrow range of experimental settings, hampering direct comparisons of ABR data and results across laboratories.
In this study, we proposed a novel approach which detects time-locked ABR waveforms via a time shift cross-correlation approach during on-going sweep averaging. Sweep averaging is terminated upon reaching a criterion for a detectable waveform at different stimulus levels and the threshold estimation was also carried out by the algorithm. The collected results were validated by human experts on the same mouse or human subjects. To verify, the total numbers of sweeps (as an indicator of test duration) were compared between cases in the algorithm and with a fixed sweep number for level averaging and prove the algorithm effective.
MATERIALS AND METHODS
Animals, Human Participants and Ethics
C57BL/6 mice were purchased from Sino-British SIPPR/BK Lab Animal Ltd. (Shanghai, China). The telomerase-knock-out mice were kindly donated by Prof. Lin Liu (Nankai University, China) and bred in house. Human participants were recruited from Shanghai Ninth People’s Hospital and consent forms were signed before the experiment. This study was conducted at the Ear Institute and the Hearing and Speech Center of the hospital. All procedures were reviewed and approved by the Institutional Authority for Laboratory Animal Care (HKDL2018503) and the Hospital Ethics Committee for Medical Research (SH9H-2019-T79-1).
ABR Recording
Mouse ABRs were recorded via a TDT RZ6/BioSigRZ system (Tuck-Davis Tech. Inc., US) in a sound-proof chamber as previously described (Lin et al., 2019). In brief, 7-week-old mice were anesthetized through intraperitoneal injection of Chloral hydrate (500 mg/kg). During the recording, animal body temperature was maintained at 37 °C using a regulated heating pad (Harvard Apparatus, US) with a rectal thermal probe placed under the animal’s body. Evoked potentials were registered via subdermal needle electrodes (Rochester Electro-Med. Inc., US) placed at the animal’s vertex (active electrode), left infra-auricular mastoid (reference electrode) and right shoulder region (ground electrode). 3-ms tone pips at 16 kHz were delivered via an MFI speaker (Tuck-Davis Tech. Inc., US) positioned in the front 10 cm from the animal’s vertex. Acoustic stimuli were presented 20 stimuli per second and the evoked potentials were sampled at 24 kHz. Artifact rejection level was set at < 35 % (mean rejection voltage 20.5 μV). Sound level series were acquired starting from 90 to 0 dB SPL (sound pressure level) with 5-dB step size. For one animal, the stimulus level series were repeated from +10 to –10 dB SPL around the estimated threshold with 1-dB step size (Fig. 3B).
Human ABRs were recorded by a commercial ABR device (Intelligent Hearing Systems, US) with Smart EP software from four volunteers aged 21-29 years without the knowledge of their medical conditions. Click sound stimulation (100 μs duration, rectangular envelopes) was generated and presented monaurally through ER3 insert earphones with foam tips. Stimuli were presented at a rate of 37.1/s with alternating polarity. Electrode impedance was < 5 kΩ and inter-electrode impedance was within ± 1 k kΩ The artifact rejection level was < 31% (rejection voltage 31 μV) to exclude contaminations from EEG and myogenic potentials. The evoked potentials were collected with 40 kHz sampling rate and × 100,000 amplification. The bandpass filter was set at 100 - 3000 Hz. Average responses over 500, 1000, and 2000 sweeps were acquired and repeated three times for the level series starting from 60 to 0 dB SPL with 5-dB step size.
Cross-correlation Analysis in Mouse ABR
Sweeps were randomly subdivided into two groups. Cross-correlation operations (MATLAB Central File Exchange Function xcorr, MathWorks, US) were applied to subgroup averages. The result of this operation yielded the correlation coefficient as a function of time shift between two signals (ABR subgroup averages). The time shift (signal lag) of the maximal coefficient was used to judge the reproducibility of ABRs. As the responses are time-locked to the acoustic stimuli, a neglectable time shift is expected. In this study, maximum allowed lag (L) for a true waveform was within one data point from time zero (equivalent to ± 0.042 ms, 1 % of the analyzed temporal window) due to system sampling error. As noise peaks could also coincidently overlapped within the desired time shift, three parallel cross-correlation runs with regrouped sweeps were implemented and false positives were rejected upon inconsistent lag values. In addition, the correlation coefficient peak amplitude was included as an independent variable (Fig. 2C).
At each stimulus level, averaging with increasing sweep numbers was iterated and the ending sweep number was noted upon a detectable response by the cross-correlation approach described above. Each iteration consists of 50 sweeps and the upper limit was set to include seven iterations (350 sweeps). The estimated threshold was just above the stimulus level at which the upper iteration limit was reached. A more precise threshold determination was done by modeling the change of the ending sweep numbers upon level series. For that both sigmoidal (1) and exponential functions (2) were employed to fit the relationship between the normalized iteration count C’ and the stimulus level S using a nonlinear least square method in MATLAB (MathWorks, US). In the functions, α1 = 0.6 and α2 = 0.25 were fixed for calibrated lag criterion (L = 1), while β1 and β2 were obtained by fitting. The estimated threshold was the corresponding S with the sigmoidal function value of 0.9 or the exponential function value of 1.0.
Cross-correlation Analysis in Human ABR
For human ABR, average responses were recorded sequentially and used as inputs in the algorithm with minor modification (Fig. S3). Instead of regrouping single sweeps as in the mouse ABR, the three combinations of two out of three average responses (E{A}, E{B}, E{C} in Fig. S3) were used for the parallel cross-correlation runs to reject false positives caused by noise peaks. When the lag condition is not fulfilled, averages over more sweeps (with a step size of 500) were used for further iterations until the upper limit of 3500 was reached. The average responses over 500, 1000 and 2000 sweeps were recorded, whereas responses over 1500, 2500, 3000 and 3500 sweeps could be obtained by weighted averaging (3) where E{m}, E{n} and E{m + n} denote the time averages over m, n and m + n sweeps, respectively.
The maximum allowed lag (L) for a true response was within seven data points from time zero (equivalent to ± 0.175 ms, 2 % of the analyzed temporal window). The estimated threshold was the lowest level with a detectable waveform.
Visual identification of ABR Threshold by Human Judges
To estimate the ground-truth thresholds of the recorded mouse and human ABRs, five clinicians were asked to independently assess the average responses and report the visually identified thresholds. The identities of the test subjects were blinded to the judges. The average responses of all level series were provided, of which either constant number of sweeps (the conventional averaging) or ending number determined by the algorithm (the algorithm termination averaging) was used. The thresholds were determined by three out of five execution judges (with the highest and the lowest value excluded) and used to evaluate the accuracy of the algorithm outcomes.
RESULTS
Cross-Correlation Analysis in On-going Averaging
ABRs are embedded in high-level background activities and system noise. Smooth baseline and clear waveform, if present, are obtained usually after averaging over hundreds of sweeps. The required number of sweeps in averaging, however, not only depends on the amplitude of the evoked response but also varies between test subjects due to variations in, for instance, skull sizes, electrode impedances and placement that determined the distances from the generator, how far reach the electrode pick up the far-field signals and the angles of the vector projections. Within an ABR recording session, these experimental parameters are fixed and the SNR of recorded sweeps between stimulus levels can be quantitatively compared. It is expected that weak response evoked by low level stimulus requires more sweeps to average than those strong responses from high level stimuli to reach similar SNR level, whereas averaging fails to improve the SNR when a response is absent. Based on this fact, we designed a novel procedure to estimate the threshold stimulus level by monitoring the change in sweep number which is required for the average response to reach a stable SNR level.
In detail, recorded sweeps at a test stimulus level were randomly divided into two groups (Fig. 1, yellow boxes) and cross-correlation coefficients (CCs) were computed between two subgroup averages (Fig. 1, green boxes). Time-locked ABR waveform, irrespective of wave latencies and amplitudes, are detected by specifying a maximum allowed time shift (L; Fig. 1, magenta boxes) within which these subgroup averages are maximum overlapped (peak of the obtained CC). In addition, three parallel runs with regrouped sweeps are used (Fig. 1, red box) so that the false waves from randomly overlapped noise peaks of similar latencies can be rejected. Next, these iteration steps repeat along with the increase of sweep number (Fig. 1, the inner loop), until either a true waveform is confirmed (consistent smaller lag than L) or the upper limit of iteration count (N) is reached. Here the iteration count limit is needed to avoid nonproductive attempts in the cases where waveforms are absent. Finally, the outer loop (Fig. 1) is implemented to scan the responses with decreasing stimulus levels. In this study, we start with 90 dB SPL in mice and 60 dB SPL in humans with a step size of 5 dB. The stop command was triggered upon a second attempt with exceeded iteration count, but the function was idled during initial optimization.
Flowchart of our algorithm for automatic threshold determination. The stimulus level starts with 90 dB SPL and the initial iteration count is one. The input is 50 sweeps recorded from a test subject. They are subdivided into two groups with corresponding subgroup averages E{A} and E{B} in each of three parallel runs (yellow boxes). Cross-correlation operation (xcorr) is applied to the subgroup averages (green boxes) and the obtained signal lags of the CC peaks are compared with the allowed time shift (L = 1 data point for mouse ABR; C1 to C3, magenta boxes). In cases when C1 to C3 are all true, the procedure starts over with lower stimulus level (red line, the outer loop), otherwise it iterates at the same stimulus level with more sweeps added (the inner loop, cyan line; 50 sweeps per iteration) until the maximum iteration count (N = 7 for mouse ABR) is reached, indicating a sub-threshold level.
Threshold Determination in Mouse ABR
To test whether the algorithm could determine the threshold automatically, we recorded single-sweep ABR sets from eight mice (three wild-type adult C57BL/6 mice of normal hearing and five telomerase knock-out mice with age-related progressive hearing threshold elevation). The raw sweeps were corrected through a smoothing spline fit to remove baseline fluctuations (Fig. S1) before being processed by the algorithm.
As illustrated in Fig. 2A, an averaged mouse ABR waveform level series is plotted with the threshold of 30 dB SPL determined by human judges. Subgroup averages (Fig. 2B) were produced in the algorithm to compute the CCs. The obtained CC peak amplitudes (Fig. 2C) and corresponding signal lags (Fig. 2D) were plotted versus stimulus levels. With reducing stimulus level, the CC peak amplitude decreases monotonically, whereas the lags at supra-threshold levels are constantly within one data point (equivalent to a time shift of ± 0.042 ms from time zero). This result suggests that the cross-correlation time shift is more sensitive to the responses at near-threshold levels than the CC, thus justified its use in our algorithm.
Threshold determination by cross-correlation analysis in mouse ABR. A Example average responses over 350 sweeps were recorded from a mouse. The visually identified threshold level (bolded) was about 30 dB SPL. B Two subgroup averages were used in the algorithm for cross-correlation analysis. C Peak amplitude of the computed CCs was plotted as a function of the level series. D Signal lag of the CC peak vs. level function was plotted. At supra-threshold levels (dots) the mean signal lags from three parallel runs were close to time zero (0.28 ± 0.46 data points, mean ± s.d.), whereas significant large variability (30.50 ± 22.51 data points, mean ± s.d.) was constantly observed at sub-threshold levels (cycles). E Plot of the count of executed iterations vs. level function. Responses that were evoked by supra-threshold stimuli (black dots) require different number of iterations to converge lags within a desired time shift (L ≤ 1 data point). After two consecutive aborts at maximum iteration count (N = 7, dash line), a detectable waveform was considered absent at the applied stimulus level (cycles) and stop command will be triggered to avoid nonproductive attempts at lower levels (triangles).
We then determine whether the algorithm could use the ending sweep number to inform the threshold level. To enable rapid threshold determination by reducing the total number of test iterations, batches of 50 sweeps were added into the subgroup averaging by iterations until stable waveforms are reached. As shown in Fig. 2E, the iteration count (proportional to the ending sweep number) remained low at high stimulus levels but increases dramatically at near-threshold levels and reached its maximum at sub-threshold levels. Besides, we found consistent results were obtained within a large range of the allowed lag (Fig. S2A) and the maximum ending sweep number (Fig. S2B), suggesting that the new method works without fine-tuning the detection parameter.
Further attempts were made to model the iteration count for precise threshold determination between the lowest supra-threshold and the highest sub-threshold level. A sigmoidal function was employed to fit the normalized iteration counts (Fig. 3A). In order to determine the corresponding function value at the true threshold level, from one animal we acquired an ABR set with peri-threshold level series of 1-dB step size (Fig. 3B). Both exponential and sigmoidal functions were used to model the change. Note that for the exponential fit only data points at supra-threshold levels were used due to early cut-off by the maximum iteration count. The lowest supra-threshold level was found when the best-fitted exponential growth reached 1.0 or ∼ 0.9 in the sigmoid growth (Fig. 3B). As fitting with sigmoid function does not require additional data exclusion, it was used to obtain the mouse threshold results for further validation of the method.
Precise threshold determination by modeling the change in iteration count with stimulus level. A The normalized iteration count vs. level function is fit by sigmoid function (red line). The best-fit function is used to estimate the threshold by level interpolation at 0.9 of the sigmoid growth. B Validation of the level interpolation with a dataset of 1-dB spaced stimulus level. The normalized iteration count vs. level function is fit by both sigmoid and exponential functions. The experimentally determined threshold is approximately at the level which corresponds to 1.0 of the best-fit exponential growth and 0.9 of the sigmoid growth.
Threshold Determination in Human ABR
To test whether the new method was compatible with human ABR, we acquired ABR sets from four human participants. Because export of single-sweep data was not an option on the commercial device we used, alternatively we use average responses over different pre-set sweep numbers (see Fig. S3 for the variant of the algorithm block diagram; see MATERIALS AND METHODS for more details). Averages (Fig. 4A) as well as subgroup averages (Fig. 4B) are shown at decreasing stimulus levels (60 dB to 0 dB SPL).
Threshold determination by cross-correlation analysis in human ABR. A Example average responses over 3500 sweeps were recorded from a human participant with the visually identified threshold of 5 dB (bolded). B Subgroup averages were used in the algorithm for the cross-correlation analysis. C CC peak amplitude was plotted as a function of the level series. D Signal lag of the CC peak vs. level function was plotted. At supra-threshold levels (dots) the mean signal lags from three parallel runs were close to time zero (1.85 ± 2.45 data points, mean ± s.d.), whereas large variability (22.67 ± 23.01 data points, mean ± s.d.) were constantly observed at sub-threshold levels (cycles). E Plot of the executed iteration count vs. level function. The supra-threshold responses converge lags within seven data points from time zero after finite number of iterations (black dots).
The CC peak amplitudes and the corresponding signal lags were plotted versus the stimulus levels (Fig. 4C and 4D). The sweep number increment was 500 per iteration and the upper limit was 3500 sweeps (at iteration count of seven). Note that we allowed slightly larger lag value (seven data points, equivalent to a time shift of ±0.175 ms from time zero) for a true waveform because a broader waveform is expected for human ABR evoked by click-sound than that of mouse ABR. As shown in Fig. 4E, the iteration count increases fast to reach its maximum near the visually identified threshold level.
Comparison between Expert and Algorithm Determined Threshold
To validate the new method, we asked five human experts to independently assess the same ABR sets and compared the visually identified thresholds to those determined by the algorithm (Table 1). Scatterplots of the algorithm determined thresholds versus the visually identified thresholds showed no significant difference for both mouse and human ABR (Fig. 5A and Fig. 5C), suggesting a reliable threshold determination by our algorithm. Besides, matched thresholds were also obtained when average responses were generated with the ending sweep numbers from the algorithm (Fig. S4A and S4B). This result suggests that extensive averaging at supra-threshold levels does not improve the detection accuracy, and thus including a large number of the sweep recording is unnecessary. We then compared the total sweep number used in two averaging methods, one with a constant sweep number (350 for mouse and 3500 for human ABR) at all stimulus levels and the other with varying sweep number based on the response detection in the algorithm. We found in algorithm a reduction of 66.76 ± 4.09 % and 53.08 ± 12.91 % (mean ± s.d.) of number of sweeps needed in mouse and human ABR, respectively (Fig. 5B and Fig. 5D).
Comparisons between Threshold Determination by Human Experts and the Algorithm
Comparisons between the thresholds determined by the algorithm and human judges. A For mouse ABR close matches between the algorithm determined thresholds and those agreed by three out of five human experts (maximum and mean discrepancies, 4 dB and 2.00 ± 1.13 dB, mean ± s.d.). Linear fit: adjust R2 = 0.97. B Comparison between the total sweeps used in the conventional level averaging with a fixed number (left bar) and in our method with varying sweep numbers at different levels (right bar). The latter requires 66.76 ± 4.09 % (mean ± s.d.) fewer sweeps than the former. Note that the sweeps were counted at all supra-threshold and two highest sub-threshold levels. C Similar to A, matched thresholds in human ABR were reported by both the algorithm and human judges (maximum and mean discrepancies, 2 dB and 0.42 ± 0.83 dB, mean ± s.d.). To illustrate overlapping data points, dots of different sizes were used. Linear fit: adjust R2 = 1.00. D The total number of sweeps used in the conventional level averaging (left bar) vs. in our method (right bar). The latter requires 53.08 ± 12.91 % (mean ± s.d.) fewer sweeps than the former.
DISCUSSION
Over decades several statistical approaches have been proposed to automate and objectify the ABR analysis. The cross-correlation approach has two advantages. First, high intra-subject waveform stability in both ABR wave latencies and amplitudes leads to the robust waveform which can be detected by cross-correlation analysis with high sensitivity. Second, it is template-free and not subject to the influence of large inter-subject waveform variability which is often presented in template-based approaches. However, prior attempts of the cross-correlation approach detect the ABR waveform with a decision boundary for a true response, for instance, minimum CC (Berninger et al., 2014; Bershad and Rockmore, 1974; Suthakar and Liberman, 2019; Weber and Fletcher, 1980) or maximum latency shift (Galbraith and Brown, 1990; Xu et al., 1995). Even with the same experimental settings, uniform SNR across recordings is not always guaranteed due to variabilities in skull size, electrode impedance and placement, as well as different sweep number used for averaging by individual experimenter. Thus, it is unlikely that calibrated decision boundary can be simply applied to another dataset without introducing detection error (in our hands up to 20 dB SPL, data not shown), limiting the application in cases like cross-institution collaboration efforts where data poolings are needed.
In contrast, our approach determines the threshold based on the relative change in the contribution of sweeps to the SNR of average response at different stimulus levels. The cross-correlation time shift approach has proven to be a reliable tool to detect the time-locked ABR waveform with high sensitivity, but in principle, it can be replaced in the algorithm by other quantifications like CC peak amplitude or Fsp (data not shown). The origin of the observed fast increase in the iteration count at near-threshold levels (Fig. 2E and Fig. 3E) is the compensation of a gradually reduced response amplitude by noise suppression through averaging. As this increase reflects relative SNR change in the responses evoked by different stimulus strengths within subject, it is therefore rather insensitive to the inter-subject system variability. Besides, the new approach was proven not heavily rely on fine-tuning of the detection parameters. First, large difference in the obtained signal lags between sub- and supra-threshold levels (Fig. 2D) allows the lag selection from a large range without affecting the waveform detection (Fig. S2A). Second, the elevation of the maximum iteration count (proportional to the sweep number increase) causes little shift to the estimated threshold level when above certain value (Fig. S2B) as a result of its fast increase with reducing stimulus levels (Fig. 3B),
Next, we showed that precise threshold determination beyond the step size of level sampling was possible by modeling the sweep number change (Fig. 3B), in our case up to 1 dB in mouse ABR. Similar attempt was also made with human ABR sets, but a reliable model could not be established due to poor model fitting. Further development of this approach is to combine with level sampling strategy like progressively reduced step size (Cebulla and Sturzebecher, 2015) and increased sweep number per iteration at near-threshold levels, so that more effective data points can be used for model fitting.
In both mouse and human ABR, the new method was proven reliable in threshold determination with a maximum discrepancy of ± 5 dB to those provided by human experts. The average responses over varying sweep numbers seemed not to introduce additional difficulty in the threshold determination (Fig. 5B and Fig. 5E). That is because at the near-threshold levels, where the SNR of responses are critical for the threshold determination, an increasing number of sweeps were averaged, whereas at the supra-threshold levels the requirement of level averaging is low. Such feature is attractive in two respects. First, it provides minimal quality control for unambiguous waveform recognition for both humans and algorithms. Such standardized data will benefit machine-learning-based approaches by minimizing annotation discrepancy in the training data (McKearney and MacKinnon, 2019). Second, when to stop averaging is an important decision during ABR recording (Don and Elberling, 1996; Madsen et al., 2018), the new method makes the ABR test more efficient by avoiding prolonged acquisition and redundant recordings.
Data Availability
All data referred to in the manuscript are available.
COMPLIANCE WITH ETHICAL STANDARDS
Conflict of Interest
The authors declare that they have no competing interests.
ACKNOWLEDGMENT
We would like to thank Y. Li, K. Han, Y. Ren, L. Yang and H. Li from Shanghai Ninth People’s Hospital for help with ABR assessment; Drs. G. Chen and L. Liu for providing terc-/- mice. This study was supported by the National Science Foundation for Young Scientists of China (81800901 to Y.H. and 81700903 to B.L.).