This paper shows an improvement in speech recognition performance for the Amazigh language using the VGG19 model. We utilized a database of the first ten spoken Amazigh numbers, and we employed mel spectrograms as the visual representation of the audio. In the initial experiment, we froze the feature extraction layers of the VGG19, and trained only the custom classification layers, under the same training conditions as our previous work. This approach resulted in a recognition accuracy of 75.55%. Then, fine-tuning the entire model over 10 epochs improved the recognition accuracy to 89.33%.