DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND DISPLAY CONTROL PROGRAM |
|||||||
申请号 | EP15896324.9 | 申请日 | 2015-06-24 | 公开(公告)号 | EP3316251A1 | 公开(公告)日 | 2018-05-02 |
申请人 | Pioneer DJ Corporation; | 发明人 | SUZUKI Shiro; KUMAKURA Takayoshi; SABI Toshihisa; | ||||
摘要 | A display controller (7) includes a noise detector (71) configured to detect noise components of a plurality of music pieces and a display control unit (72) configured to display a detection result of the noise detector (71) on a display unit (5). The display control unit (72) includes: a result display (721) configured to display the detection result of the noise components in association with time information of each of the plurality of music pieces; and a choice detector (722) configured to detect that a predetermined section of a first music piece of the plurality of music pieces is chosen; and a display changer (723) configured to change a display state of the detection result of at least one of the plurality of music pieces other than the first music piece according to the detection result of the noise components in the chosen section. | ||||||
权利要求 | |||||||
说明书全文 | The present invention relates to a display controller, a display control method, and a display control program. There has been typically known an arrangement of switching a first music piece, which is being reproduced (hereinafter referred to as a "preceding music piece"), to a second music to be reproduced after the preceding music piece (hereinafter referred to as a "subsequent music piece") (see, for instance, Patent Literature 1). In the arrangement disclosed in Patent Literature 1, in order to switch the preceding music piece to the subsequent music piece by cross-fade, a music player acquires a beat timing X immediately before a start timing of fade-out of the preceding music piece and acquires a beat timing Y immediately after a finish timing of fade-in of the subsequent music piece. The music player advances the start of reproducing the subsequent music piece during the reproduction of the preceding music piece so that the beat timing X coincides with the beat timing Y. This operation enables a user, who is performing an exercise and the like to rhythm of music, to reproduce the music in a switching manner without disturbing rhythm of the exercise and the like. Patent Literature 1: The aforementioned cross-fade is one mixing method in a DJ performance, for which such processing as disclosed in Patent Literature 1 may be used. However, such processing as disclosed in Patent Literature 1, which only allows the preceding music piece and the subsequent music piece to coincide with each other in terms of the beat timing, may cause discords to occur when both of the preceding music piece and the subsequent music piece are being reproduced. For this reason, it is necessary for the DJ to listen to the preceding music piece and the subsequent music piece in advance and predetermine a position of each of the preceding music piece and the subsequent music piece, where no discord occur and which the preceding music piece and the subsequent music piece are compatible with each other in mixing. Such a preparation is troublesome. An object of the invention is to provide a display controller, a display control method, and a display control program which are capable of supporting a favorable mixing of music pieces. According to an aspect of the invention, a display controller includes: a noise detector configured to detect a noise component in a plurality of music pieces, and a display control unit configured to display a detection result obtained by the noise detector on a display unit, in which the display control unit includes: a result display configured to display the detection result in association with time information about each of the plurality of music pieces; a choice detector configured to detect that a predetermined section is chosen in a first music piece of the plurality of music pieces; and a display changer configured to change a display state of the detection result of at least one of the plurality of music pieces other than the first music piece according to the detection result of the noise component in the chosen section. According to another aspect of the invention, a display control method of a display controller is for displaying information about a sound component of a music piece on a display unit, the method being performed by the display controller and including: detecting a noise component in a plurality of music pieces; displaying a detection result of the detecting in association with time information about each of the plurality of music pieces; detecting that a predetermined section is chosen in a first music piece of the plurality of music pieces; and changing a display state of the detection result of at least one of the plurality of music pieces other than the first music piece according to the detection result of the noise component in the chosen section. According to still another aspect of the invention, a display control program controls a display controller to perform the display control method according to the above aspect of the invention.
Exemplary embodiment(s) of the invention will be described below with reference to the attached drawings. Firstly, an arrangement of a music piece reproduction apparatus according to an exemplary embodiment of the invention will be described with reference to As shown in Cross-fade between noise and noise has been known for a favorable compatibility with each other since occurrence of discords is unlikely during the cross-fade. Cross-fade between harmonic sounds and harmonic sounds has been known for a poor compatibility with each other since occurrence of discords is likely during the cross-fade. It should be noted that harmonic sounds mean high pitch sounds having a harmonic structure including harmonics and fundamentals. Noise mean sounds other than the harmonic sounds, in other words, no pitch sounds having no harmonic structure. Examples of the harmonic sounds include voices and sounds of a piano, a guitar and a bass guitar. Examples of the noise include sounds of a drum, percussion and scratching. The music piece reproduction apparatus 1 supports favorable cross-fade of music pieces in a manner to avoid occurrence of discords as described above or to reduce apparent discords (i.e., occurrence of discords for a user not to feel uneasy). The music piece reproduction apparatus 1 includes a first storage 2, a second storage 3, an operation unit 4, a display unit 5, an audio processor 6, and a display controller 7. The first storage 2 is configured to store music piece data 21 and the like. The music piece data 21 may be stored in an external device or an external server capable of communicating with the audio processor 6 and the display controller 7. The second storage 3 is configured to store a display control program and various data such as a compatibility setting table as shown in The operation unit 4 includes a key board, a mouse, a touch panel and the like (which are not shown). The display unit 5 includes a liquid crystal display and the like. The audio processor 6 is configured to apply a signal processing (e.g., cross-fade) to the music piece data 21 stored in the first storage 2 on a basis of an operation of a jog dial, a pitch controller (not shown) and the like, thereby outputting a processed audio signal to the audio output unit 8. The display controller 7 includes a noise detector 71, a display control unit 72, a first memory 73, and a second memory 74. The noise detector 71 and the display control unit 72 are configured to process the display control program and data stored in the second storage 3 using CPU (Central Processing Unit). The noise detector 71 is configured to detect a noise component and a harmonic sound component contained in each of a plurality of music pieces. The noise detector 71 includes a section divider 711, a component detector 712, a ratio calculator 713, and a section attribute judging unit 714. The section divider 711 is configured to acquire the music piece data 21 from the first storage 2 in response to the operation of the operation unit 4. The section divider 711 divides the music piece data 21 per a predetermined unit and acquires the divided section data. Although the music piece data 21 is divided per measure in the exemplary embodiment, for instance, the music piece data 21 may be divided per beat or may be divided per development after analyzing the development of the music piece in advance. The component detector 712 is configured to detect a noise component contained in each section of the music piece on a basis of the section data acquired by the section divider 711. The ratio calculator 713 is configured to calculate a ratio of the noise component contained in each section on a basis of the detection result obtained by the component detector 712 and store the calculation result in the first memory 73. The section attribute judging unit 714 is configured to judge whether each section is a noise section or a harmonic section on the basis of the calculation result obtained by the ratio calculator 713 and store the judgment result in the second memory 74. The display control unit 72 displays the detection result obtained by the noise detector 71 on the display unit 5. The display control unit 72 includes a result display 721, a choice detector 722, and a display changer 723. The result display 721 is configured to associate the detection result obtained by the noise detector 71 with time information of the preceding music piece and the subsequent music piece and display the obtained information on the display unit 5. Specifically, as shown in The preceding music piece information 5 includes a waveform 501 of the preceding music piece and sound component information 502 of the preceding music piece. The sound component information 502 includes a plurality of section bars 503. As shown in The choice detector 722 is configured to detect that a part of the time information of the preceding music piece is chosen by the operation unit 4. The choice detector 722 detects that a predetermined one of the section bars 503 of the preceding music piece information 50 is chosen, when a choice is determined while a cursor CR is displayed on the predetermined one of the section bars 503 as shown by a chain double-dashed line in The display changer 723 is configured to change a display state of the detection result of the subsequent music piece according to the detection result of the noise component in the chosen section. The display changer 723 is configured to set compatibility between the chosen section and each of the sections of the subsequent music piece on the basis of a compatibility setting table stored in the second storage 3 and data stored in the first memory 73 and the second memory 74. The display changer 723 is configured to display compatibility information 554 expressing the compatibility over the corresponding section bars 553 as shown in It should be noted that the display positions of the compatibility information 554 and the noise ratio information 555 are not limited to the aforementioned positions but may be any positions clearly indicating correspondence of the compatibility information 554 and the noise ratio information 555 to the section bars 553. Next, a music piece analysis processing and a music piece information display processing will be described as operations of the music piece reproduction apparatus 1. Firstly, the music piece analysis processing will be described with reference to As shown in Next, the component detector 712 analyzes the section data to measure power spectra shown in Subsequently, as shown in The component detector 712 detects a harmonic structure component (Pgr) (i.e., a harmonic sound component) from the power spectra (Step S6). Specifically, when at least two of the four power spectra corresponding to the same note are equal to or more than a harmonic sound recognition threshold Lm, in other words, when the same note is expressed by sound in at least two octaves, the component detector 712 judges that the sound component of this note is the harmonic structure component. On the other hand, when no or a single power spectrum is equal to or more than the harmonic sound recognition threshold Lm, the component detector 712 judges that the sound component of this note is not the harmonic structure component. For instance, in the power spectra as shown in Since cross-fade between harmonic sounds is likely to generate discords as described above, it is not favorable to propose this combination to a user as a good cross-fade compatibility. However, for instance, rapping (i.e., a musical form of vocal delivery to sing like a rhythmic speech with less melody while rhyming, for instance, at an end of a measure), in which harmonic sounds are repeated with the same pitch, is less likely to generate discords during cross-fade with other harmonic sounds than harmonic sounds without repeating the same pitch. Accordingly, in the exemplary embodiment, the harmonic sounds of rapping and the like with the same pitch repeated are regarded as noise. In order to propose the harmonic sounds of rapping to the user as sounds that are less likely to generate discords during cross-fade with other harmonic sounds, the following processing is performed at Step S7 and S8. As shown in In this processing at Step S7, the component detector 712 detects the harmonic sound component recognizable as the noise component. Subsequently, as shown in In this processing at Step S8, the sound component recognizable as the noise component is excluded from the power spectra regarded as the sound component in terms of the component structure, thereby calculating the sound component amount. Next, as shown in Subsequently, the section attribute judging unit 714 judges whether or not the noise component is equal to or more than the noise recognizable threshold (e.g., 51%) (Step S11). When judging that the conditions of Step S11 are satisfied, the section attribute judging unit 714 recognizes the Mth section as the noise section and stores a noise section flag in the second memory 74 in association with the music piece and the section number M (Step S12). On the other hand, when judging that the conditions of Step S11 are not satisfied, the section attribute judging unit 714 stores a harmonic section flag indicating the harmonic section in the second memory 74 in association with the music piece and the section number M (Step S13). After the section attribute judging unit 714 conducts the processing of Step S12 or Step S13, the section divider 711 increments the section number M by 1 (Step S14). The section attribute judging unit 714 judges whether analysis of the last section of the music piece is finished (Step S15). When the analysis is not finished yet, the processing of Step S3 is conducted. When judging that the analysis is finished, the music piece analysis processing ends. When the same harmonic structure component is detected in the consecutive four sections in the processing of Steps S7 to S9 as described above, the harmonic structure component at the latest section is regarded as the noise component and the noise component ratio is calculated. However, although the harmonic structure components of three sections previous to the latest section can be regarded as the noise components, in some cases of the processing of each of the three sections, the noise component ratio is calculated without including the harmonic structure components of the three sections as the noise components, since the same harmonic structure component is not yet consecutively detected in the four sections. In these cases, it is optionally conducted to recalculate the noise component ratio with the harmonic structure component of the above three sections as the noise component, to update data in the first memory 73, and to update the section flags in the second memory 74 based on the re-calculation result of the noise component ratio. Next, the music piece information display processing will be described with reference to The music piece information display processing follows the music piece analysis processing conducted to a plurality of music pieces. Firstly, the user operates the operation unit 4 to choose a preceding music piece and a subsequent music piece for cross-fade. As shown in Although a case where a single music piece is chosen for each of the preceding music piece and the subsequent music piece is described in the exemplary embodiment, the same processing is also conducted in a case where at least two music pieces are chosen for at least one of the preceding music piece and the subsequent music piece. The result display 721 acquires from the first memory 73 and the second memory 74 the total sound component amount, the noise component ratio and the section flags (i.e., the noise section flag or the harmonic section flag) about each of the sections of the preceding music piece and the subsequent music piece (Step S24). Subsequently, the result display 721 displays the preceding music piece information 50 and the subsequent music piece information 55 on the display unit 5 (Step S25). At this time, the result display 721 may display the preceding music piece information 50 and the subsequent music piece information 55 of all the sections of the music pieces at the same time. Alternatively, the result display 721 may display the preceding music piece information 50 and the subsequent music piece information 55 about a part of the sections and update with the preceding music piece information 50 and the subsequent music piece information 55 of the remaining sections by operating the operation unit 4. The result display 721 displays the waveforms 501, 551 based on the music piece data. The result display 721 also displays the sound component information 502, 552 based on the total sound component amount and each section flag. Specifically, the result display 721 sets a color of the section bar 503 in each of the sections forming the preceding music piece based on Table 1 below, and displays the sound component information 502, in which the section bars 503 are aligned in a sequence for reproducing the sections, below the waveform 501. Also as for the subsequent music piece, the result display 721 sets a color of each of the section bars 553 and displays the sound component information 552 below the waveform 551. By visually checking the section bars 503, 553 whose colors are set according to Table 1, the user can recognize both of the attribute of each section (whether each section is the noise section) and the sound intensities of all the sections. After the preceding music piece information 50 and the subsequent music piece information 55 are displayed on the display unit 5 as shown in When the choice detector 722 detects that the predetermined section of the preceding music piece is chosen (Step S26), the display changer 723 sets compatibility between the chosen section and each section of the subsequent music piece according to the compatibility setting table shown in The compatibility setting table shows the scores of 70 or more expressing a good compatibility when both of a section of the preceding music piece and a section of the subsequent music piece are noise sections (Rs ≥ noise recognizable threshold (51%)). The compatibility setting table also shows the scores of less than 70 expressing a poor compatibility when both the sections of the preceding music piece and the subsequent music piece are harmonic sections (Rs < noise recognizable threshold). Further, the compatibility setting table shows scores expressing a good compatibility when one of the sections of the preceding music piece and the subsequent music piece is the noise section and the other of the sections is the harmonic section. Furthermore, the compatibility setting table shows that the scores expressing the compatibilities between the chosen sections of the preceding music piece and the corresponding sections of the subsequent music piece are increased according to an increase in the noise component ratios of the corresponding sections of the subsequent music piece. The higher score expressing the compatibility means less generation of discords, leading to the better compatibility. As shown in Subsequently, the user sets a combination of sections for cross-fade on the basis of the display of the display unit 5, whereby the audio processor 6 functions according to the combination. For instance, the audio processor 6 starts reproducing the preceding music piece and then performs cross-fade between a chosen section of the preceding music piece and a chosen section of the subsequent music piece, thereby finishing reproducing the preceding music piece and starting reproducing the subsequent music piece. During the cross-fade, the user may operate a jog dial and the like to fade out the preceding music piece and fade in the subsequent music piece or adjust volumes of the music pieces. This processing may be automatically performed by the audio processor 6 based on the user's setting. When the user sets a section of the preceding music piece for cross-fade using the operation unit 4, the audio processor 6 detects this setting and sets the section as a section for cross-fade. Simultaneously, the audio processor 6 can set one of all sections of the subsequent music piece favorably compatible with the set section of the preceding music piece as a section suitable for cross-fade, while setting one of the sections of the subsequent music piece poorly compatible with the set section of the preceding music piece as an unsettable section. For instance, when the set section of the preceding music piece is the harmonic section, the audio processor 6 can set a noise section of the subsequent music piece as a section for cross-fade and set a harmonic section as an unsettable section based on the section flags of the second memory 74. Similarly, when the set section of the preceding music piece is the noise section, the audio processor 6 can set all the sections of the subsequent music piece as the sections suitable for cross-fade. As described above, the display controller 7 detects the noise components of a plurality of music pieces and displays on the display unit 5 the detection result in association with the time information corresponding to the plurality of music pieces. When the display controller 7 detects that a predetermined section of a single music piece (preceding music piece) is chosen from the plurality of music pieces, the display controller 7 changes a display state of the detection result of the other music piece (subsequent music piece) according to the detection result of the noise component in the predetermined section. This operation enables the user to easily discern a section for cross-fade (mixing) well compatible with the chosen section of the preceding music piece based on the display state of the detection result on the subsequent music piece. Accordingly, the display controller 7 capable of supporting favorable cross-fade of the music pieces can be provided. Since the time information of the music pieces is expressed particularly with the section bars 503, 553 in the exemplary embodiment, the user can intuitively understand the detection result of noise in each of the time information as compared with when the time information is expressed only with characters such as a "section 1." The display controller 7 also changes the display state of the detection result of the subsequent music piece by displaying the compatibility information 554 expressing the compatibility for the cross-fade with the chosen section of the preceding music piece. This operation enables the user to easily recognize the compatibility for cross-fade by visually checking the compatibility information 554. Since the compatibility information 554 is expressed particularly with the characters in the exemplary embodiment, the user can more easily recognize the compatibility for cross-fade than when the compatibility information 554 is displayed in colors other than the characters. In the exemplary embodiment, when the chosen section of the preceding music piece is the harmonic section, the compatibility information 554 expressing a good compatibility for cross-fade between the noise section of the subsequent music piece and the chosen section is displayed. When the chosen section is the noise section, the compatibility information 554 expressing a good compatibility for cross-fade between all the sections of the subsequent music piece and the chosen section is displayed. This operation enables the user to more easily recognize the compatibility for cross-fade by visually checking the compatibility information 554 expressing a favorably compatible section. The display controller 7 also displays the compatibility information 554 at a position where the compatibility information 554 is not superimposed on the sound component information 552. This operation enables the user to more easily recognize the compatibility for cross-fade than when the sound component information 552 is displayed while being superimposed on the compatibility information 554, for instance, when the compatibility information 554 is displayed within the section bars 553. The scope of the invention is not limited only to the above exemplary embodiments but can include various improvement and design modification compatible with the invention. For instance, although the result display 721 displays on the display unit 5 the sound component information 502 and 552 each expressing both of the attribute and the sound intensities of the sections in the above exemplary embodiment, the result display 721 may display on the display unit 5 sound component information 502A and 552A each expressing the attribute and the sound intensities of the sections individually as shown in The sound component information 502A includes: noise ratio information 505A including a plurality of section bars 506A; and sound intensity information 507A including a plurality of section bars 508A. The sound component information 552A, which has a structure similar to that of the sound component information 502A, includes noise ratio information 555A including a plurality of section bars 556A and sound intensity information 557A including a plurality of section bars 558A. The noise ratio information 505A and 555A shows the noise component ratios of the sections. The section bars 506A and 556A of the respective noise ratio information 505A and 555A are displayed in a blue color at the noise component ratio being less than 25%, in a light blue color at the noise component ratio ranging from 25% to less than 50%, in an orange color at the noise component ratio ranging from 50% to less than 75%, and in a red color at the noise component ratio being 75% or more. The sound intensity information 507A and 557A represents the sound intensities of the sections. The section bars 508A and 558A of the respective sound intensity information 507A and 557A are displayed in a green color at the total sound component amount being less than a first intensity threshold, in a light green color at the total sound component amount ranging from the first intensity threshold to less than a second intensity threshold, in a yellow green color at the total sound component amount ranging from the second intensity threshold to less than a third intensity threshold, and in a yellow color at the total sound component amount being equal to or more than the third intensity threshold. The sound intensity information 507A and 557A is not necessarily displayed. When a predetermined section is chosen by the cursor CR shown in a chain double-dashed line in a state shown in At this time, when the noise section is chosen as a section for cross-fade with the harmonic section, discords are less likely to be generated. It is expected that the higher noise ratio of the noise section generates less discords. Displaying the noise ratio information 505A and 555A only indicating the noise component ratios on the display unit 5 as shown in When the predetermined section of the preceding music piece is chosen in the state shown in The colors of the section bars 503, 553, 506A, 556A and 559B shown in The result display 721 and the display changer 723 may set predetermined colors respectively for colors of the waveforms 501 and 551 per se corresponding to the sections, colors of frames surrounding the waveforms 501 and 551 or colors inside the frames to a predetermined color, thereby displaying the noise ratio (detection result) and the sound intensity or the compatibility. Moreover, the result display 721 and the display changer 723 may change a size of the section bars 503, 553, 506A, 556A and 559B and the compatibility information 554 and 554B or may flash the section bars 503, 553, 506A, 556A and 559B and the compatibility information 554 and 554B, thereby displaying the noise ratio (detection result) and the sound intensity or the compatibility. Alternatively, the result display 721 and the display changer 723 may display the noise ratio and the sound intensity or the compatibility with a figure such as a circle or a triangle or with characters such as "high (noise component ratio)," "strong sound" and "good (compatibility)." Although expressing the time information of the music pieces with the section bars 503, 553, 506A, 556A and 559B, the result display 721 and the display changer 723 may express the time information with characters such as "section 1" and "section with a reproduction time ranging from 1 minute 0 seconds to 1 minute 5 seconds." In this case, the noise ratio and the sound intensity or the compatibility may be displayed above and/or below or on the left and/or right sides of the characters expressing the time information. Alternatively, the noise ratio and the sound intensity or the compatibility may be expressed by setting a color, a size and the like of the characters expressing the time information. When two or more music pieces are chosen as at least one of the preceding music piece and the subsequent music piece, the result display 721 and the display changer 723 may display the sound component information and the compatibility information about the two or more chosen music pieces at the same time. Alternatively, the result display 721 and the display changer 723 each may include a plurality of display units and display the information about the preceding music piece on one(s) of the display units and the information about the subsequent music piece on the rest of the display units. The display changer 723 may superimpose the sound component information on the compatibility information about the music pieces, for instance, by displaying characters expressing the compatibility within the section bars 553 shown in When the chosen section of the preceding music piece is the harmonic section, the display changer 723 may only display the compatibility information 554 about the noise section of the subsequent music piece without displaying the compatibility information 554 about the harmonic section. In other words, the display changer 723 may display the compatibility information 554 only about a section having a good compatibility for cross-fade with the chosen section. When the chosen section of the preceding music piece is the harmonic section, the display changer 723 may only display the compatibility information 554 about the harmonic section of the subsequent music piece without displaying the compatibility information 554 about the noise section. When the chosen section of the preceding music piece is the noise section, the display changer 723 does not necessarily display the compatibility information 554 about all the sections of the subsequent music piece. In other words, the display changer 723 may display the compatibility information 554 only about a section having a poor compatibility for cross-fade with the chosen section. The display changer 723 may display the compatibility information of the preceding music piece when a predetermined section of the subsequent music piece is chosen. The noise detector 71 may include no section divider 711. Instead, the component detector 712 may consecutively acquire the music piece data 21 from the first storage 2 and process unanalyzed data among the acquired music piece data in the same manner as in Steps S4, S6 and S7 at every predetermined time. The ratio calculator 713 may calculate the noise component ratio (Rs) based on the number of the power spectra forming the harmonic structure component. For instance, when the power spectra are measured as shown in The display controller of the invention may be used in products other than a DJ device such as a music player as disclosed in Patent Literature 1.
|