Ted21 audio view

[AdamStrangeParticipant]

Here is a quick look at work in progress with new audio document viewer.

I’m basically taking parts of the Wave2 audio core and graphics routines and directly putting them into Ted21.

Currently only the base monkey2 16bit wav and ogg are supported. but I do have all the code for dealing with aiff, 12/24bit wavs, fairlight, amiga aiff, and other synth based sample loading.

I’m also toying with the idea of bringing the entire synth subsystem over as well, along with the full sample editing systems.

Attachments:

1. 

   Screen-Shot-2016-08-17-at-14.37.16.png
   

[AdamStrangeParticipant]

And the final version with everything operational.

You can see the highlighted octave slightly darkened. the note is also shown on the piano view when pressed.

Attachments:

1. 

   Screen-Shot-2016-08-18-at-14.04.10.png
   

[AdamStrangeParticipant]

Just a small update here. I’ve been into the mojo source and added the ability to see where the playhead is. I’ve also coloured the pressed key in the current selection color. Playhead is always in white with black:

Attachments:

1. 

   Screen-Shot-2016-08-18-at-14.04.10-1.png
   

[Mark SiblyKeymaster]

Looks good, but what’s the source like? Is it a simple ‘drop replacement’ for the current AudioDocumentView?

[AdamStrangeParticipant]

mmmm, That’s a really interesting question.

You’d need to make a tiny change to mojo/audo/audio.monkey2:

Monkey

#rem monkeydoc Channel playhead in samples. If the channel is playing audio this will return the position of the playhaed in the played sound. #end Property Playhead:Float() If Not _alSource Return 0 ' Local proc:ALint ' alGetSourcei( _alSource,AL_BUFFERS_PROCESSED,Varptr proc ) ' Print "processed: "+proc Local playhead:ALfloat alGetSourcef( _alSource, AL_SAMPLE_OFFSET, Varptr playhead ) Return playhead ' local pos:float ' return alGetSourcef( _alSource, AL_SAMPLE_OFFSET, Varptr pos ) End

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22

#rem monkeydoc Channel playhead in samples. If the channel is playing audio this will return the position of the playhaed in the played sound. #end Property Playhead:Float() If Not _alSource Return 0 ' Local proc:ALint ' alGetSourcei( _alSource,AL_BUFFERS_PROCESSED,Varptr proc ) ' Print "processed: "+proc   Local playhead:ALfloat alGetSourcef( _alSource, AL_SAMPLE_OFFSET, Varptr playhead )   Return playhead     ' local pos:float ' return alGetSourcef( _alSource, AL_SAMPLE_OFFSET, Varptr pos ) End

Ignoring some hard wired colors it should be good to go. I’ve done a quick comparison to the ted2 audiodocument and everything looks like it should compile – You’ll need to add the custom colors to mojo as well

There’s a lot of repeated code – I was going to make a class to wrap it all up.

Here’s the full source:

Monkey

Namespace ted21 const _pureNotes := New float[] ( 16.35, 17.32, 18.35, 19.45, 20.60, 21.83, 23.12, 24.50, 25.96, 27.50, 29.14, 30.87, 32.70, 34.65, 36.71, 38.89, 41.20, 43.65, 46.25, 49.00, 51.91, 55.00, 58.27, 61.74, 65.41, 69.30, 73.42, 77.78, 82.41, 87.31, 92.50, 98.00, 103.8, 110.0, 116.5, 123.5, 130.8, 138.6, 146.8, 155.6, 164.8, 174.6, 185.0, 196.0, 207.7, 220.0, 233.1, 246.9, 261.6, 277.2, 293.7, 311.1, 329.6, 349.2, 370.0, 392.0, 415.3, 440.0, 466.2, 493.9, 523.3, 554.4, 587.3, 622.3, 659.3, 698.5, 740.0, 784.0, 830.6, 880.0, 932.3, 987.8, 1047, 1109, 1175, 1245, 1319, 1397, 1480, 1568, 1661, 1760, 1865, 1976, 2093, 2217, 2349, 2489, 2637, 2794, 2960, 3136, 3322, 3520, 3729, 3951, 4186, 4435, 4699, 4978, 5274, 5588, 5920, 6272, 6645, 7040, 7459, 7902 ) global _notes := New Float[9, 17] Class AudioDocumentView Extends View Field _timer:Timer Method New( doc:AudioDocument ) Local j:Int Local k:Int Local freq:Float Local count:Int = 0 For k = 0 To 8 For j = 0 To 11 freq = _pureNotes[count] _notes[k, j] = freq/220 If j < 5 _notes[k, j+12] = freq/110 '' PureNote[count] = freq/220 count = count + 1 Next Next _doc = doc Layout = "fill" Style.BackgroundColor = new Color(.1, .1, .1)'App.Theme.GetColor( "content" ) If Not _chan _chan = New Channel _timer = New Timer(10, OnUpdate) End Protected Method OnLayout() Override ' _toolBar.Frame=Rect End Method GetSample:Float( channel:Int, length:int, index:Int ) Select _doc.Data.Format Case AudioFormat.Mono8 Return _doc.Data.Data[index]/128.0-1 Case AudioFormat.Stereo8 Return _doc.Data.Data[index*2+(channel&1)]/128.0-1 Case AudioFormat.Mono16 Return Cast<Short Ptr>( _doc.Data.Data )[index]/32767.0 Case AudioFormat.Stereo16 Return Cast<Short Ptr>( _doc.Data.Data )[index*2+(channel&1)]/32767.0 End Select Return 0 End Method DrawWaveform( canvas:Canvas, x:int, y:int, width:float, height:float) Local data := _doc.Data Local halfHeight:float = height * .5 Local quarterHeight:float = height * .25 Local quarterHeight2:float = height - quarterHeight Local last:float Local curr:float Local last2:float Local curr2:float Local sample:float Local xpos:int ' Print halfHeight+" "+quarterHeight Local chan:int = 0 Local stereo:bool = False Local bits:int = 8 Select _doc.Data.Format Case AudioFormat.Stereo8 stereo = True Case AudioFormat.Mono16 bits = 16 Case AudioFormat.Stereo16 bits = 16 stereo = True End Select canvas.Color = new Color( 0, .1, 0 ) canvas.DrawRect( x, y, width, height ) If stereo Then canvas.Color = Color.Black canvas.DrawLine( x, y+halfHeight, x+width, y+halfHeight ) canvas.Color = Color.White canvas.DrawLine( x, y+quarterHeight, x+width, y+quarterHeight ) canvas.DrawLine( x, y+quarterHeight2, x+width, y+quarterHeight2 ) canvas.Color = new Color( .39, .69, 0 ) last = y + quarterHeight last2 = y + quarterHeight2 For xpos = 0 to width-x ' Print xpos+" "+dataLength+" "+(xpos * widthLength) sample = GetSample( 0, data.Length, Float(xpos) / width * data.Length ) curr = quarterHeight + y + (quarterHeight * sample) sample = GetSample( 1, data.Length, Float(xpos) / width * data.Length ) curr2 = quarterHeight2 + y + (quarterHeight * sample) If xpos Then canvas.DrawLine( xpos-1+x, last, xpos+x, curr ) canvas.DrawLine( xpos-1+x, last2, xpos+x, curr2 ) End if last = curr last2 = curr2 Next else canvas.Color = Color.White canvas.DrawLine( x, y+halfHeight, x+width, y+halfHeight ) canvas.Color = new Color( .39, .69, 0 ) last = halfHeight + y Local currSample:int For xpos = 1 to width-x-1 currSample = Float(xpos) / width * data.Length sample = GetSample( chan, data.Length, currSample ) curr = halfHeight + y + (halfHeight * sample) canvas.DrawLine( xpos-1+x, last, xpos+x, curr ) last = curr Next Local diff:float = width / data.Length 'Print diff xpos = diff * _chan.Playhead canvas.Color = Color.White canvas.DrawLine( xpos+x, 0, xpos+x, height ) canvas.Color = Color.Black canvas.DrawLine( xpos+x+1, 0, xpos+x+1, height ) End if End method Method CheckVolumePan( mx:int, my:int, x:float, y:float, width:float, height:float) If my < 40 Then Return 'pan If my < 80 Then Local midx:float = width * .5 Local diff:float = 2 / width Local xpos:float = (mx - midx) * diff _pan = xpos _chan.Pan = _pan Return End If 'volume If my < 90 Then Return my -= 90 height -= 100 If my > height Then Return ' Print my +" " ' Print ((height - my) / (height*0.8)) _volume = float(height - my) / float(height) _chan.Volume = _volume 'Print _volume End method Method DrawVolume( canvas:Canvas, title:string, x:int, y:int, width:int, height:int) Local data := _doc.Data Local dataLength:int = data.Length canvas.Color = new Color( .2, .2, .2 ) canvas.DrawRect( x, y+30, width, height-30 ) canvas.Color = new Color( .3, .3, .3 ) canvas.DrawRect( x, y, width, 30 ) Local midx:int = x + (width * .5) Local stereo:bool = False Select _doc.Data.Format Case AudioFormat.Stereo8 stereo = True Case AudioFormat.Stereo16 stereo = True End Select 'draw volume canvas.Color = new Color( .1, .1, .1 ) If stereo Then canvas.DrawRect( x+10, y+80, 24, height-90 ) canvas.DrawRect( x+36, y+80, 24, height-90 ) Else canvas.DrawRect( x+10, y+80, 50, height-90 ) End If 'draw volume text canvas.Color = Color.LightGrey Local ht:float = (height - 11) - (81) Local yp:int Local xp:int = x + 60 yp = y + height - 19 - (ht * 1) canvas.DrawText( "-100", xp+10, yp ) yp = y + height - 19 - (ht * .75) canvas.DrawText( "- 75", xp+10, yp ) yp = y + height - 19 - (ht * .5) canvas.DrawText( "- 50", xp+10, yp ) yp = y + height - 19 - (ht * .25) canvas.DrawText( "- 25", xp+10, yp ) yp = y + height - 19 - (ht * 0) canvas.DrawText( "- 0", xp+10, yp ) 'draw volume indicator yp = y + height - 11 - (ht * _volume) canvas.Color = Color.UIBlue canvas.DrawLine( xp, yp, xp-50, yp ) canvas.LineWidth = 4 canvas.DrawLine( xp, yp, xp+15, yp-10 ) canvas.DrawLine( xp+15, yp-10, xp+45, yp-10 ) canvas.DrawLine( xp+45, yp-10, xp+50, yp-5 ) canvas.DrawLine( xp+50, yp-5, xp+50, yp+5 ) canvas.DrawLine( xp+50, yp+5, xp+45, yp+10 ) canvas.DrawLine( xp+45, yp+10, xp+15, yp+10 ) canvas.DrawLine( xp+15, yp+10, xp, yp ) 'draw pan Local pn:float = _pan * (width-15) * .5 canvas.Color = new Color( .1, .1, .1 ) canvas.DrawRect( x+10, y+40, width-20, 30 ) canvas.Color = Color.LightGrey canvas.DrawLine( midx, y+40, midx, y+70 ) canvas.Color = Color.UIBlue canvas.DrawLine( midx + pn, y+40, midx + pn, y+70 ) 'the last thing is to draw the new text canvas.Color = Color.LightGrey canvas.Scale( 1.5, 1.2 ) '<- this sets the matrix canvas.DrawText( title, x+10, (y+5)*0.837 ) canvas.ClearMatrix() End method method DrawKey( canvas:Canvas, color:int, text:string, x:float, y:float, width:float, height:float ) Select color Case 0 canvas.Color = Color.Black Case 1 canvas.Color = new Color( .9, .9, .83 ) Case 2 canvas.Color = new Color( 1, 1, .44 ) End Select canvas.DrawRect( x, y, width, height ) Select color Case 0 canvas.Color = Color.White Default canvas.Color = Color.Black End Select canvas.DrawText( text, x+10, y+5 ) End method Method DrawKeys( canvas:Canvas, octave:int, note:int, x:float, y:float, width:float, height:float ) Local ht:float = height / 8 Local height1:float = ht * 3 Local height2:float = ht * 6 Local width1:float = height1 - 5 Local halfWidth:float = width1 * 0.5 Local xx:float = x + halfWidth Local yy:float = y DrawKey( canvas, 0, "s", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 0, "d", xx, yy, width1, width1 ) xx += height1 + height1 DrawKey( canvas, 0, "g", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 0, "h", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 0, "j", xx, yy, width1, width1 ) xx += height1 + height1 DrawKey( canvas, 0, "l", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 0, ";", xx, yy, width1, width1 ) xx += height1 * 3 yy += height1 + height1 canvas.Color = Color.White canvas.DrawText( "Octave Up/Down", xx, yy ) yy -= height1 canvas.DrawText( (octave + 1), xx+height1, yy ) yy -= height1 DrawKey( canvas, 2, "[", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 2, "]", xx, yy, width1, width1 ) xx = x yy += height1 DrawKey( canvas, 1, "z", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "x", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "c", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "v", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "b", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "n", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "m", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, ",", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, ".", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "/", xx, yy, width1, width1 ) yy += height1 canvas.Color = Color.White canvas.DrawText( "Music Keyboard", x+(height1*3), yy ) End method Method DrawPiano( canvas:Canvas, octave:int, octaveOffset:int, note:int, x:int, y:int, width:int, height:int ) canvas.Color = new Color( .9, .9, .83 ) canvas.DrawRect( x, y, width, height ) Local oct:Float = Float(width / 8.0) Local k:Int Local keyheight:Int = Float((height-2) * 0.66666) Local nt:Float = Float(oct / 7.0) Local nt2:Float = nt / 2.0 Local j:Int Local count:Int = 0 Local noteDown:int = -1 if note > -1 Then noteDown = note + (octave + octaveOffset) * 12 End If 'draw highlighted octave canvas.Color = new Color( .68, .62, .48 ) canvas.DrawRect( x + (octave * oct), y, oct+1, height ) 'draw white keypress If noteDown > -1 Then Local offset:int = -1 Select note Case 0 offset = 0 Case 2 offset = 1 Case 4 offset = 2 Case 5 offset = 3 Case 7 offset = 4 Case 9 offset = 5 Case 11 offset = 6 End Select If offset > -1 and octave + octaveOffset < 8 Then canvas.Color = Color.UIBlue'new Color( 0, .55, 0 ) canvas.DrawRect( x + ( (octave + octaveOffset) * oct) + (offset * nt), y, nt, height ) End if End If count = 0 For k = 0 To 7 Local xx:Float = x + (oct * k) + nt Local x1:Float = xx - (nt / 4) For j = 0 To 6 'draw key lines If j < 6 Or k < 7 Then canvas.Color = Color.DarkGrey canvas.DrawLine( xx, y, xx, y + height ) End If 'draw black keys If j = 2 Or j = 6 Else count = count + 1 'black key If count = noteDown Then canvas.Color = Color.UIBlue'new Color( 0, .55, 0 ) Else canvas.Color = Color.Black End If canvas.DrawRect( x1, y, nt / 1.5, keyheight ) End If xx = xx + nt x1 = x1 + nt count = count + 1 Next Next End method Method OnUpdate() ' Local pos:float = _chan.Playhead /_doc.Data.Length ' _chan.Rate *= 0.95 ' Local diff:float = width / data.Length ' xpos = diff * _chan.Playhead ' Print _count+" "+_chan.Playhead ' _count += 1 ' If Keyboard.KeyReleased(Key.Escape) Then instance.Terminate() ' App.RequestRender() End Method Method OnRender( canvas:Canvas ) Override Local quarterHeight:float = Height * .35 Local audioHeight:float = Height - quarterHeight DrawWaveform( canvas, 0, 0, Width, audioHeight ) DrawPiano( canvas, _octave, _noteOctave, _note, 140, audioHeight+10, Width - 150, quarterHeight * .5 ) DrawKeys( canvas, _octave, _note, 140, audioHeight+20+quarterHeight * .5, Width - 150, (quarterHeight * .5) - 30 ) DrawVolume( canvas, "Master", 10, audioHeight+10, 120, quarterHeight-20 ) End Method OnMouseEvent( event:MouseEvent ) Override Select event.Type Case EventType.MouseDown Local quarterHeight:float = Height * .35 Local audioHeight:float = Height - quarterHeight Local mx:int = event.Location.X Local my:int = event.Location.Y If mx > 20 And mx < 120 And my > audioHeight+10 Then CheckVolumePan( mx-20, my-(audioHeight+10), 20, audioHeight+10, 100, quarterHeight-20 ) End If ' if event.Location.X < 16 Then ' Case EventType.MouseUp ' _dragging = False Case EventType.MouseMove If Mouse.ButtonDown( MouseButton.Left ) Then Local quarterHeight:float = Height * .35 Local audioHeight:float = Height - quarterHeight Local mx:int = event.Location.X Local my:int = event.Location.Y If mx > 20 And mx < 120 And my > audioHeight+10 Then CheckVolumePan( mx-20, my-(audioHeight+10), 20, audioHeight+10, 100, quarterHeight-20 ) End If End If ' Case EventType.MouseWheel ' Super.OnMouseEvent( event ) ' Return End Select End Method OnKeyEvent( event:KeyEvent ) Override Select event.Type Case EventType.KeyUp If _note > -1 Then _note = -1 _chan.Stop() End If Case EventType.KeyRepeat Case EventType.KeyDown _noteOctave = 0 Select event.Key Case Key.Space If _chan.Playing Then _chan.Stop() Else _chan.Pan = _pan _chan.Volume = _volume _chan.Play( _doc.Sound ) End If Case Key.LeftBracket If _octave > 0 Then _octave -= 1 Case Key.RightBracket If _octave < 7 Then _octave += 1 Case Key.Z _note = 0 _chan.Rate = _notes[_octave, 0] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.S _note = 1 _chan.Rate = _notes[_octave, 1] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.X _note = 2 _chan.Rate = _notes[_octave, 2] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.D _note = 3 _chan.Rate = _notes[_octave, 3] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.C _note = 4 _chan.Rate = _notes[_octave, 4] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.V _note = 5 _chan.Rate = _notes[_octave, 5] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.G _note = 6 _chan.Rate = _notes[_octave, 6] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.B _note = 7 _chan.Rate = _notes[_octave, 7] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.H _note = 8 _chan.Rate = _notes[_octave, 8] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.N _note = 9 _chan.Rate = _notes[_octave, 9] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.J _note = 10 _chan.Rate = _notes[_octave, 10] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.M _note = 11 _chan.Rate = _notes[_octave, 11] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.Comma If _octave = 8 Then return _note = 0 _noteOctave = 1 _chan.Rate = _notes[_octave+1, 0] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.L If _octave = 8 Then return _note = 1 _noteOctave = 1 _chan.Rate = _notes[_octave+1, 1] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.Period If _octave = 8 Then return _note = 2 _noteOctave = 1 _chan.Rate = _notes[_octave+1, 2] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.Semicolon If _octave = 8 Then return _note = 3 _noteOctave = 1 _chan.Rate = _notes[_octave+1, 3] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.Slash If _octave = 8 Then return _note = 4 _noteOctave = 1 _chan.Rate = _notes[_octave+1, 4] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) End Select End Select End method Private field _chan:Channel field _volume:float = .8 field _pan:float = 0 field _octave:int = 4 field _note:int = -1 field _noteOctave:int = 0 Field _doc:AudioDocument ' Field _count:long = 0 End Class AudioDocument Extends Ted2Document Method New( path:String ) Super.New( path ) _view = New AudioDocumentView( Self ) End Property Data:AudioData() Return _data End Property Sound:Sound() If Not _sound _sound = New Sound( _data ) Return _sound End Protected Method OnLoad:Bool() Override _data = AudioData.Load( Path ) If Not _data Return False Return True End Method OnSave:Bool() Override Return False End Method OnClose() Override If _sound then _sound.Discard() If _data then _data.Discard() _sound = Null _data = Null End Method OnCreateView:AudioDocumentView() Override Return _view End Private Field _view:AudioDocumentView Field _data:AudioData Field _sound:Sound End

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729

Namespace ted21     const _pureNotes := New float[] ( 16.35, 17.32, 18.35, 19.45, 20.60, 21.83, 23.12, 24.50, 25.96, 27.50, 29.14, 30.87, 32.70, 34.65, 36.71, 38.89, 41.20, 43.65, 46.25, 49.00, 51.91, 55.00, 58.27, 61.74, 65.41, 69.30, 73.42, 77.78, 82.41, 87.31, 92.50, 98.00, 103.8, 110.0, 116.5, 123.5, 130.8, 138.6, 146.8, 155.6, 164.8, 174.6, 185.0, 196.0, 207.7, 220.0, 233.1, 246.9, 261.6, 277.2, 293.7, 311.1, 329.6, 349.2, 370.0, 392.0, 415.3, 440.0, 466.2, 493.9, 523.3, 554.4, 587.3, 622.3, 659.3, 698.5, 740.0, 784.0, 830.6, 880.0, 932.3, 987.8, 1047, 1109, 1175, 1245, 1319, 1397, 1480, 1568, 1661, 1760, 1865, 1976, 2093, 2217, 2349, 2489, 2637, 2794, 2960, 3136, 3322, 3520, 3729, 3951, 4186, 4435, 4699, 4978, 5274, 5588, 5920, 6272, 6645, 7040, 7459, 7902 )   global _notes := New Float[9, 17]   Class AudioDocumentView Extends View   Field _timer:Timer     Method New( doc:AudioDocument ) Local j:Int Local k:Int Local freq:Float Local count:Int = 0   For k = 0 To 8 For j = 0 To 11 freq = _pureNotes[count] _notes[k, j] = freq/220 If j < 5 _notes[k, j+12] = freq/110 '' PureNote[count] = freq/220 count = count + 1 Next Next   _doc = doc   Layout = "fill" Style.BackgroundColor = new Color(.1, .1, .1)'App.Theme.GetColor( "content" ) If Not _chan _chan = New Channel _timer = New Timer(10, OnUpdate) End     Protected     Method OnLayout() Override ' _toolBar.Frame=Rect End     Method GetSample:Float( channel:Int, length:int, index:Int  ) Select _doc.Data.Format Case AudioFormat.Mono8 Return _doc.Data.Data[index]/128.0-1 Case AudioFormat.Stereo8 Return _doc.Data.Data[index*2+(channel&1)]/128.0-1 Case AudioFormat.Mono16 Return Cast<Short Ptr>( _doc.Data.Data )[index]/32767.0 Case AudioFormat.Stereo16 Return Cast<Short Ptr>( _doc.Data.Data )[index*2+(channel&1)]/32767.0 End Select Return 0 End     Method DrawWaveform( canvas:Canvas, x:int, y:int, width:float, height:float) Local data := _doc.Data   Local halfHeight:float = height * .5 Local quarterHeight:float = height * .25 Local quarterHeight2:float = height - quarterHeight Local last:float Local curr:float Local last2:float Local curr2:float Local sample:float Local xpos:int ' Print halfHeight+" "+quarterHeight Local chan:int = 0 Local stereo:bool = False Local bits:int = 8 Select _doc.Data.Format Case AudioFormat.Stereo8 stereo =  True Case AudioFormat.Mono16 bits = 16 Case AudioFormat.Stereo16 bits = 16 stereo =  True End Select canvas.Color = new Color( 0, .1, 0 ) canvas.DrawRect( x, y, width, height )   If stereo Then canvas.Color = Color.Black canvas.DrawLine( x, y+halfHeight, x+width, y+halfHeight ) canvas.Color = Color.White canvas.DrawLine( x, y+quarterHeight, x+width, y+quarterHeight ) canvas.DrawLine( x, y+quarterHeight2, x+width, y+quarterHeight2 )   canvas.Color = new Color( .39, .69, 0 ) last = y + quarterHeight last2 = y + quarterHeight2 For xpos = 0 to width-x ' Print xpos+" "+dataLength+" "+(xpos * widthLength) sample = GetSample( 0, data.Length, Float(xpos) / width * data.Length ) curr =  quarterHeight + y + (quarterHeight * sample) sample = GetSample( 1, data.Length, Float(xpos) / width * data.Length ) curr2 =  quarterHeight2 + y + (quarterHeight * sample)   If xpos Then canvas.DrawLine( xpos-1+x, last, xpos+x, curr ) canvas.DrawLine( xpos-1+x, last2, xpos+x, curr2 ) End if last = curr last2 = curr2 Next else canvas.Color = Color.White canvas.DrawLine( x, y+halfHeight, x+width, y+halfHeight ) canvas.Color = new Color( .39, .69, 0 ) last = halfHeight + y Local currSample:int For xpos = 1 to width-x-1 currSample = Float(xpos) / width * data.Length sample = GetSample( chan, data.Length, currSample ) curr =  halfHeight + y + (halfHeight * sample)   canvas.DrawLine( xpos-1+x, last, xpos+x, curr ) last = curr Next Local diff:float = width / data.Length 'Print diff xpos = diff * _chan.Playhead canvas.Color = Color.White canvas.DrawLine( xpos+x, 0, xpos+x, height ) canvas.Color = Color.Black canvas.DrawLine( xpos+x+1, 0, xpos+x+1, height ) End if End method     Method CheckVolumePan( mx:int, my:int, x:float, y:float, width:float, height:float) If my < 40 Then Return 'pan If my < 80 Then Local midx:float = width * .5 Local diff:float = 2 / width Local xpos:float = (mx - midx) * diff _pan = xpos _chan.Pan = _pan Return End If 'volume If my < 90 Then Return my -= 90 height -= 100 If my > height Then Return ' Print my +" " ' Print ((height - my) / (height*0.8)) _volume = float(height - my) / float(height) _chan.Volume = _volume 'Print _volume End method Method DrawVolume( canvas:Canvas, title:string, x:int, y:int, width:int, height:int) Local data := _doc.Data Local dataLength:int = data.Length   canvas.Color = new Color( .2, .2, .2 ) canvas.DrawRect( x, y+30, width, height-30 )   canvas.Color = new Color( .3, .3, .3 ) canvas.DrawRect( x, y, width, 30 )   Local midx:int = x + (width * .5) Local stereo:bool = False Select _doc.Data.Format Case AudioFormat.Stereo8 stereo =  True Case AudioFormat.Stereo16 stereo =  True End Select 'draw volume canvas.Color = new Color( .1, .1, .1 ) If stereo Then canvas.DrawRect( x+10, y+80, 24, height-90 ) canvas.DrawRect( x+36, y+80, 24, height-90 ) Else canvas.DrawRect( x+10, y+80, 50, height-90 ) End If   'draw volume text canvas.Color = Color.LightGrey Local ht:float = (height - 11) - (81) Local yp:int Local xp:int = x + 60   yp = y + height - 19 - (ht * 1) canvas.DrawText( "-100", xp+10, yp ) yp = y + height - 19 - (ht * .75) canvas.DrawText( "- 75", xp+10, yp ) yp = y + height - 19 - (ht * .5) canvas.DrawText( "- 50", xp+10, yp ) yp = y + height - 19 - (ht * .25) canvas.DrawText( "- 25", xp+10, yp ) yp = y + height - 19 - (ht * 0) canvas.DrawText( "-  0", xp+10, yp )   'draw volume indicator yp = y + height - 11 - (ht * _volume) canvas.Color = Color.UIBlue canvas.DrawLine( xp, yp, xp-50, yp ) canvas.LineWidth = 4 canvas.DrawLine( xp, yp, xp+15, yp-10 ) canvas.DrawLine( xp+15, yp-10, xp+45, yp-10 ) canvas.DrawLine( xp+45, yp-10, xp+50, yp-5 ) canvas.DrawLine( xp+50, yp-5, xp+50, yp+5 ) canvas.DrawLine( xp+50, yp+5, xp+45, yp+10 ) canvas.DrawLine( xp+45, yp+10, xp+15, yp+10 ) canvas.DrawLine( xp+15, yp+10, xp, yp )   'draw pan Local pn:float = _pan * (width-15) * .5 canvas.Color = new Color( .1, .1, .1 ) canvas.DrawRect( x+10, y+40, width-20, 30 ) canvas.Color = Color.LightGrey canvas.DrawLine( midx, y+40, midx, y+70 ) canvas.Color = Color.UIBlue canvas.DrawLine( midx + pn, y+40, midx + pn, y+70 )     'the last thing is to draw the new text canvas.Color = Color.LightGrey canvas.Scale( 1.5, 1.2 ) '<- this sets the matrix canvas.DrawText( title, x+10, (y+5)*0.837 ) canvas.ClearMatrix() End method   method DrawKey( canvas:Canvas, color:int, text:string, x:float, y:float, width:float, height:float ) Select color Case 0 canvas.Color = Color.Black Case 1 canvas.Color = new Color( .9, .9, .83 ) Case 2 canvas.Color = new Color( 1, 1, .44 ) End Select canvas.DrawRect( x, y, width, height )   Select color Case 0 canvas.Color = Color.White Default canvas.Color = Color.Black End Select   canvas.DrawText( text, x+10, y+5 ) End method Method DrawKeys( canvas:Canvas, octave:int, note:int, x:float, y:float, width:float, height:float ) Local ht:float = height / 8 Local height1:float = ht * 3 Local height2:float = ht * 6 Local width1:float = height1 - 5 Local halfWidth:float = width1 * 0.5 Local xx:float = x + halfWidth Local yy:float = y DrawKey( canvas, 0, "s", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 0, "d", xx, yy, width1, width1 ) xx += height1 + height1 DrawKey( canvas, 0, "g", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 0, "h", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 0, "j", xx, yy, width1, width1 ) xx += height1 + height1 DrawKey( canvas, 0, "l", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 0, ";", xx, yy, width1, width1 )   xx += height1 * 3 yy += height1 + height1 canvas.Color = Color.White canvas.DrawText( "Octave Up/Down", xx, yy ) yy -= height1 canvas.DrawText( (octave + 1), xx+height1, yy ) yy -= height1 DrawKey( canvas, 2, "[", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 2, "]", xx, yy, width1, width1 )   xx = x yy += height1 DrawKey( canvas, 1, "z", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "x", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "c", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "v", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "b", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "n", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "m", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, ",", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, ".", xx, yy, width1, width1 ) xx += height1 DrawKey( canvas, 1, "/", xx, yy, width1, width1 )   yy += height1 canvas.Color = Color.White canvas.DrawText( "Music Keyboard", x+(height1*3), yy ) End method Method DrawPiano( canvas:Canvas, octave:int, octaveOffset:int, note:int, x:int, y:int, width:int, height:int ) canvas.Color = new Color( .9, .9, .83 ) canvas.DrawRect( x, y, width, height )   Local oct:Float = Float(width / 8.0) Local k:Int Local keyheight:Int = Float((height-2) * 0.66666) Local nt:Float = Float(oct / 7.0) Local nt2:Float = nt / 2.0 Local j:Int Local count:Int = 0 Local noteDown:int = -1 if note > -1 Then noteDown = note + (octave + octaveOffset) * 12 End If 'draw highlighted octave canvas.Color = new Color( .68, .62, .48 ) canvas.DrawRect( x + (octave * oct), y, oct+1, height )   'draw white keypress If noteDown > -1 Then Local offset:int = -1 Select note Case 0 offset = 0 Case 2 offset = 1 Case 4 offset = 2 Case 5 offset = 3 Case 7 offset = 4 Case 9 offset = 5 Case 11 offset = 6 End Select If offset > -1 and octave + octaveOffset < 8 Then canvas.Color = Color.UIBlue'new Color( 0, .55, 0 ) canvas.DrawRect( x + ( (octave + octaveOffset) * oct) + (offset * nt), y, nt, height ) End if End If count = 0 For k = 0 To 7 Local xx:Float = x + (oct * k) + nt Local x1:Float = xx - (nt / 4) For j = 0 To 6 'draw key lines If j < 6 Or k < 7 Then canvas.Color = Color.DarkGrey canvas.DrawLine( xx, y, xx, y + height ) End If   'draw black keys If j = 2 Or j = 6 Else count = count + 1 'black key If count = noteDown Then canvas.Color = Color.UIBlue'new Color( 0, .55, 0 ) Else canvas.Color = Color.Black End If canvas.DrawRect( x1, y, nt / 1.5, keyheight ) End If xx = xx + nt x1 = x1 + nt count = count + 1 Next Next End method Method OnUpdate() ' Local pos:float = _chan.Playhead /_doc.Data.Length ' _chan.Rate *= 0.95 ' Local diff:float = width / data.Length   ' xpos = diff * _chan.Playhead   ' Print _count+" "+_chan.Playhead ' _count += 1 ' If Keyboard.KeyReleased(Key.Escape) Then instance.Terminate() ' App.RequestRender()   End Method     Method OnRender( canvas:Canvas ) Override Local quarterHeight:float = Height * .35 Local audioHeight:float = Height - quarterHeight DrawWaveform( canvas, 0, 0, Width, audioHeight )   DrawPiano( canvas, _octave, _noteOctave, _note, 140, audioHeight+10, Width - 150, quarterHeight * .5 ) DrawKeys( canvas, _octave, _note, 140, audioHeight+20+quarterHeight * .5, Width - 150, (quarterHeight * .5) - 30 )   DrawVolume( canvas, "Master", 10, audioHeight+10, 120, quarterHeight-20 ) End     Method OnMouseEvent( event:MouseEvent ) Override Select event.Type Case EventType.MouseDown Local quarterHeight:float = Height * .35 Local audioHeight:float = Height - quarterHeight Local mx:int = event.Location.X Local my:int = event.Location.Y   If mx > 20 And mx < 120 And my > audioHeight+10 Then CheckVolumePan( mx-20, my-(audioHeight+10), 20, audioHeight+10, 100, quarterHeight-20 ) End If ' if event.Location.X < 16 Then ' Case EventType.MouseUp ' _dragging = False          Case EventType.MouseMove If Mouse.ButtonDown( MouseButton.Left ) Then Local quarterHeight:float = Height * .35 Local audioHeight:float = Height - quarterHeight Local mx:int = event.Location.X Local my:int = event.Location.Y   If mx > 20 And mx < 120 And my > audioHeight+10 Then CheckVolumePan( mx-20, my-(audioHeight+10), 20, audioHeight+10, 100, quarterHeight-20 ) End If End If          ' Case EventType.MouseWheel ' Super.OnMouseEvent( event ) ' Return          End Select End     Method OnKeyEvent( event:KeyEvent ) Override Select event.Type Case EventType.KeyUp If _note > -1 Then _note = -1 _chan.Stop() End If Case EventType.KeyRepeat Case EventType.KeyDown _noteOctave = 0 Select event.Key Case Key.Space If _chan.Playing Then _chan.Stop() Else _chan.Pan = _pan _chan.Volume = _volume _chan.Play( _doc.Sound ) End If Case Key.LeftBracket If _octave > 0 Then _octave -= 1 Case Key.RightBracket If _octave < 7 Then _octave += 1 Case Key.Z _note = 0 _chan.Rate = _notes[_octave, 0] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.S _note = 1 _chan.Rate = _notes[_octave, 1] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.X _note = 2 _chan.Rate = _notes[_octave, 2] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.D _note = 3 _chan.Rate = _notes[_octave, 3] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.C _note = 4 _chan.Rate = _notes[_octave, 4] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.V _note = 5 _chan.Rate = _notes[_octave, 5] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.G _note = 6 _chan.Rate = _notes[_octave, 6] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.B _note = 7 _chan.Rate = _notes[_octave, 7] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.H _note = 8 _chan.Rate = _notes[_octave, 8] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.N _note = 9 _chan.Rate = _notes[_octave, 9] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.J _note = 10 _chan.Rate = _notes[_octave, 10] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.M _note = 11 _chan.Rate = _notes[_octave, 11] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.Comma If _octave = 8 Then return _note = 0 _noteOctave = 1 _chan.Rate = _notes[_octave+1, 0] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.L If _octave = 8 Then return _note = 1 _noteOctave = 1 _chan.Rate = _notes[_octave+1, 1] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.Period If _octave = 8 Then return _note = 2 _noteOctave = 1 _chan.Rate = _notes[_octave+1, 2] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.Semicolon If _octave = 8 Then return _note = 3 _noteOctave = 1 _chan.Rate = _notes[_octave+1, 3] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) Case Key.Slash If _octave = 8 Then return _note = 4 _noteOctave = 1 _chan.Rate = _notes[_octave+1, 4] _chan.Volume = _volume _chan.Pan = _pan _chan.Play( _doc.Sound ) End Select End Select   End method   Private     field _chan:Channel field _volume:float = .8 field _pan:float = 0 field _octave:int = 4 field _note:int = -1 field _noteOctave:int = 0   Field _doc:AudioDocument ' Field _count:long = 0 End       Class AudioDocument Extends Ted2Document   Method New( path:String ) Super.New( path ) _view = New AudioDocumentView( Self ) End     Property Data:AudioData() Return _data End   Property Sound:Sound() If Not _sound _sound = New Sound( _data ) Return _sound End   Protected   Method OnLoad:Bool() Override _data = AudioData.Load( Path ) If Not _data Return False Return True End     Method OnSave:Bool() Override Return False End     Method OnClose() Override If _sound then _sound.Discard() If _data then _data.Discard() _sound = Null _data = Null End     Method OnCreateView:AudioDocumentView() Override Return _view End   Private   Field _view:AudioDocumentView Field _data:AudioData Field _sound:Sound   End

[Mark SiblyKeymaster]

I like the ‘Playhead’ addition, will definitely add that although I think I might use ‘SampleIndex:Int’, just a bit more descriptive I think. You can apparently write to it too!

And it’s cool that you managed to implement the whole thing by simply extending View and TedDocument, nice work.

[AdamStrangeParticipant]

there are actually 3 kinds of positions data:

AL_SEC_OFFSET,  AL_BYTE_OFFSET and  AL_SAMPLE_OFFSET

the first one AL_SEC_OFFSET is time based

Glad you approve

[AdamStrangeParticipant]

I like the ‘Playhead’ addition, will definitely add that although I think I might use ‘SampleIndex:Int’, just a bit more descriptive I think

mmmm. I thought about that and here’s my answer:

Playhead is the industry standard for the position of any playing/position thingy

if you talk about playhead to a sound engineer in reference to a sound clip they know what you mean. it is the current position of the sound that is playing.

similarly, playhead means the current position in a song

or in a media clip of any kind.

You would never say “move the sample index of clip 4 to position 1423 please” You would say “Move the playhead to the middle”, etc

Where you would use something like sample index is in talking to a computer. The computer has no concept of a playhead, but likes direct position information.

 

Playhead, just makes sense

 

OK, second thought

Sample index. Monkey2 doesn’t use samples it uses sounds (they might be actual samples of sound), but they are Sounds. Sounds are played by channels.

Using sample index is bringing in another layer of complexity. suddenly to position the playhead in a channel, I must know that a channel is playing a sound and a sound is really a sample?

 

Now you and I both know exactly what is going on underneath the hood. You say sample index, I say playhead. But The best this we can aim for here is clarity and simplicty. If everyone knows what a playhead is, surely it make sense to call it playhead?

 

Q “How did you make it loop like that?”

A “I just reset the playhead to the start at this point”

” ah ok, makes sense”

 

Q “How did you make it loop like that?”

A “I made the SampleIndex 0”

Q “The what?”

A “the sample index… a sound is a sample and it has an index”

etc, etc

[Author]

Posts