If you’re a new reader, check out some of these older posts! I hope you’ll find the information, pictures and videos in them to be interesting and informative.

Stale Cheerios: The Ten Best Posts of 2010

1. But he knew how to do it last time…
This is a gem of a post that I had completely forgotten about.
What does it mean when our animals “forget” their training?

2. 2010 Art and Science of Animal Training Conference Notes
I couldn’t pick just one of these to include in the list, so I’m including a link to all of them.
This was a fantastic conference.

3. Lessons from Pat Parelli and Catwalk
How should we handle EXTREME behavior problems?

4. Book Review: Getting to Yes by Sharon Foley
I really enjoyed this book.
Check it out if you’re looking for more info about clicker training with horses.

5. When do I start Clicker Training?
What prerequisite skills does a horse need before clicker training?

6. Clicker Train your Horse to Take a Bath at Liberty
In this video, Apollo demonstrates that teaching a horse to take a bath can be fun and stress free.

7. Shaping Behaviors in a Goldfish using Clicker Training
Clicker training isn’t just for dogs and horses–it’s great for fish, too!

8. Train your Horse to Wear a Fly Mask
In this photo essay, Dionne and Boomer show just how fun fly masks can be.
(Warning: Great photos!)

9. 10 Tips to Improve your Clicker Training
This one was definitely a reader favorite. Some of these are a great place to start if you’re looking to improve your training skills in 2010. Many apply to training in general–not just clicker training.

10. If you give a horse a cookie…
A new research study determines that treats don’t cause bad behavior in horses.

Bonus! Spectacular Photos: Rescue Horses at the Waterhole
By far my favorite photos of 2010.
From your comments, I think they were your favorite photos too!

The great thing about loopy training is that you’re probably already using it! However, the loopy training model gives us a clear framework to look at training. Loopy training helps us see what makes great training great and helps us figure out what’s going on when problems occur. If we can formalize and name concepts (such as the loopy training concept), it makes the training process more deliberate, simpler to teach and easier to discuss and assess.

Basics of Good Training (just so we’re all on the same page!)

Animal training (as Bob Bailey often says) is a mechanical skill. We shouldn’t let poor mechanics get in the way of good training. Alexandra Kurland shared three things that contribute to great training:

• Clear, well, defined criteria
• Great timing
• High rates of reinforcement

In addition, good training requires that we are splitters, not lumpers. Being a splitter means that when teaching, we break down behaviors into small enough pieces so that the animal can be successful.

Alexandra Kurland talked some about poisoned cues, which can occur when we combine positive reinforcement with negative reinforcement. (I’m going to save poisoned cues for another post in an effort to keep this one a reasonable length!) Basically, though, when we use aversives or when we use negative reinforcement poorly, the emotional effects linger long after the use of corrections has stopped. Clicker training can bypass the poisoned cue effect by retraining old behaviors in new ways.

We want happy, exuberant, eager to please animals and this is what we usually see when training with positive reinforcement. It’s important to retrain familiar behaviors even if the horse already “knows that” because these simple behaviors become anchor behaviors as we build more complex behaviors and loops. If we build a strong foundation, cues for simple behaviors can be used to reinforce and build more complex behaviors.

By now you’re wondering…what the heck is loopy training?

We generally think of behavior using the following model:

Cue –> Behavior –> Click –> Deliver Reinforcer

However, this is too simple of a model. This is how training really looks:

Cue –> Behavior –> Click –> Deliver Reinforcer –> Cue –> Behavior –> Click –> Deliver Reinforcer –> Cue –> Behavior –> Click –> Deliver Reinforcer –> Cue –> Behavior –> Click –> Deliver Reinforcer

Behaviors and training happens as a LOOP, rather than as a single instance in time. Also, although we might be thinking only of the cue we’re giving and the behavior we want to reinforce, there’s actually a lot more behavior going on! The goal in training is to create clean loops.

A clean loop will have the following features:

• No unwanted behaviors in the loop
• Animal performs all elements smoothly
• Behaviors in the loop are performed with no hesitation

The framework of loopy training emphasizes that all elements in a loop need to be clean, both before and after the click. If you have a clean loop, you can (and should!) move on. If you have a behavior loop that stays messy and does not seem to be getting cleaner, reassess your training. Are you asking for too much? Have you skipped a step? How can you better motivate your horse or improve communication?

The Click as a Cue

The click serves several different functions and ends up getting called all sorts of different names, a marker signal, a yes answer signal, a conditioned reinforcer, a bridging signal, a highlighter.

Most importantly, the clicker, if used properly, functions as a cue, or a green light for earning reinforcement. This idea came out of a research project at the University of North Texas. In that study, the trainer had a nice clean loop with a dog touching a target across the room. She delivered treats by tossing them into a bowl at her feet. However, in order to increase precision, she changed from tossing the treats to dropping them down a piece of PVC pipe.

Her clean loop fell apart completely. After the click and food delivery, the dog stopped, looked at her, paused and then repeated the behavior. The dog made several more attempts and looked quite frustrated before giving up all together! In this situation, the click was serving as a cue to look at the handler and watch for the toss and landing of the food. The dog stopped and looked, but because of the new PVC pipe, no toss happened. The poor confused dog had no idea what was going on.

Feeding skills and food delivery are essential for good training! The animal must know when and how food is delivered and must be able to collect the food promptly, efficiently and safely. We can have different ways of delivering food (tossing on the ground, tossing to the animal, giving to the animal, etc.) but we must train each and make sure the food delivery part of the loop is always clean. When horses mug for treats, it often indicates that either they have not been taught proper manners and self control around food or that our food delivery is inefficient or clumsy.

Inefficient, awkward or clumsy food delivery will break down the smooth flow of the loop. I watched a DVD last semester where the trainer was delivering food by tossing it on the floor. The dog did not know how to watch the throw and find the food. So, there was lots of extra sniffing and searching behavior and the pace of the training was often interrupted. The trainer eventually got the behavior, but the process was neither efficient, nor elegant.

What are your foundation lessons?

Good training starts with small chunks. If we can get small, clean chunks of behavior then it is easy to start combining  to get more complex patterns.

Once we have clean loops for at least two to three behaviors its easy to start mixing and matching. Having a clean loop does not mean the behavior is perfect, it just means the cycle is fluid without any unwanted behavior. Once we build an inventory of simple loops we can start on more complicated loops. Importantly, we can also use the cues and behaviors in our simple loops to reinforce other behaviors we are working on.

Alexandra has six basic foundation lessons she teaches her horses. This is a way to introduce the horse to training and start building some simple loops. The foundation lessons she selects are important because they teach behaviors related to self control and safety, as well as being behaviors that can be expanded later to teach all sorts of other behaviors.

Having organized foundation lessons means that you have a plan for training. You understand what skills are essential to teach the animal early on and you recognize how these skills can be combined or developed to teach more advanced behaviors. Foundations skills are like loops. Very likely, you already use them, but you’ve never formalized them.

So I have a clean loop, now what?

Here’s a nice simple loop that you might see in horse training (or dog training):

cue –> horse backs up several steps –> click –> deliver reinforcer –> cue –> horse backs up several steps –> click –> deliver reinforcer –> cue –> and so on!

How can we use this to our advantage in training?

In our loopy model, cues serve a double function. A cue can:

1. 1. Tell the animal what next behavior will earn reinforcement.
2. 2. Reinforce whatever behavior occurred previously.

So, later on we might have:

cue 1 –> horse backs up several steps –> cue 2–> horse lowers her head–> click –> deliver reinforcer –> cue 1 –> horse backs up several steps –> cue 2 –> horse lovers her head –> click –> deliver reinforcer –> cue 1 –> and so on!

If both behaviors started out as clean loops, we can easily combine them into a larger loop. More importantly, we can use the cue for head lowering to reinforce really good backing up. So, we ask for the horse to back up. When we get several really good steps of backing up, we ask for head lowering. Since the head lowering cue signals a chance to earn reinforcement, the cue itself will reinforce good backing up.

As the animal learns more behaviors, we can combine them in all sorts of ways and patterns until we end up with quite complex loops. We might have head lowering then backing then head lowering then a click and treat, then a hindquarter yield and then backing and then click treat then 5 target touches and repeat. Clean training is built on loops, even if it might be difficult to see them at the more advanced and complex stages. When coming up with a training plan at more complex stages of training, think about where you need the primary reinforcement and what the horse is telling you he needs to work on.

Loopy Training, Poisoned Cues and Negative Reinforcement

Loopy training is the antidote for poisoned cues because poisoned cues are a product of lumping. When we teach behavior too quickly or in too big of chunks, we often end up with frustrated, annoyed animals who are not enthusiastic about training. These poisoned cues don’t work well in loops! We can avoid frustration and unwanted behavior by building tight, clean loops that gradually spiral outward.

Most of the time when we use negative reinforcement we’re guilty of lumping. It’s not the negative reinforcement that poisons the cues, but the lumping that creates stress, frustration and confusion for our horses. We can create equally frustrated animals if we’re using positive reinforcement, but lumping behaviors together rather than splitting and shaping gradually. Now, this doesn’t mean train in the tiniest steps possible. It only means we must progress at a level where the animal can continue to be a successful learner.

Later on, we can also use loops to give our horses a choice or to let them cue us. What is very important to animals is how much control they have over the environment. We can make our animals more confident and comfortable by giving them more control. For instance, you could teach your horse to touch a target before you put on the saddle. The horse then learns he can use the target touch to tell you when he’s ready to for you to saddle him. If the horse later on chooses not to touch the target, then it’s up to you to figure out why he doesn’t want to be saddled that day.

Loopy training helps us be more deliberate as trainers. Behavior happens as a cycle, or loop, rather than as a discrete unit. If we can see these loops and learn how to use cues more effectively, our training and animals will benefit. At the core, loops work because they teach us to split behavior in small chunks and get good quality behavior before trying to move on.

If you enjoyed this post, you might enjoy the rest of my notes from the 2010 Art and Science of Animal Training Conference or my notes from the 2009 conference. Better yet, bookmark the ORCA website and come to the 2011 conference next spring! Sign up for e-mail updates to make sure you don’t miss any of the great posts from stalecheerios.com.

(I am still adding notes from the conference. Be sure to check back or sign up for e-mail updates to stay informed. As part of ORCA I also got to spend extra time with the speakers. I learned a lot and will post a bit about what I learned and, importantly, how I plan to apply it to my training.)

Links to some of my thoughts and notes on each speaker:
Robert Epstein, who presented on creativity and engineering novel behavior in animals
Alexandra Kurland, who discussed the loopy training model
Kay Laurence, discussed assessing your training skills
Bob Bailey, who discussed some of the history of animal training
Ken Ramirez, who talked about how good animal trainers need people skills too!
Steve Martin, who talked about motivation and trust

The panel discussion also included:
Jen White
Steve White
Cassie Malina
Jesús Rosales Ruiz

I’m exhausted, a bit sick with a cold and tired of the rain, but what a great weekend. The fun started Thursday with picking up Alexandra Kurland from the airport and then listening to Janet Twyman lecture during my autism class. The weekend was really a whirlwind of lecture, discussion, occasionally a bit of debate. I got up before dawn this morning and drove Bob Bailey to the airport in the rain and then came home and collapsed.

I’m still processing the weekend and need to spend some time going back over my notes. I’m really starting to understand the power of loopy training and notice when good training takes advantage of it. As well, we had some really good discussions on shaping, prompts and lures. Basically, I’m understanding better how to quickly and efficiently get behavior with minimal guessing or frustration from the animal. As well, my understanding of negative reinforcement is becoming more refined. The key now is to really play around with some of these ideas and see how they apply to training the horses, dog and goldfish I work with.

Blossom is all ears for future posts. Do you want to stay in the loop? Sign up for e-mail updates or RSS updates so you won’t miss out on anything!

1. Aggressive Training Methods and Aggressive Dogs
2. An Introduction to Reinforcement
3. Building Duration with 300 Peck Pigeons
4. Fish Training Progress
5. ORCA Great Minds Part 1: Steve Martin
6. In a Whisper or In a Shout? Training Under Time Constraints
7. Teaching the Parelli Friendly Game with Clicker Training
8. Waterhole Ritual 1: Sharing Territory
9. What is Stimulus Control?
10. What Makes Something Scary?

I took tons of notes and ended up feeling slightly overwhelmed by the end of the day! Some of the information was completely new to me, much of it was concepts I had heard before, but presented in a new way. I have far too many notes or thoughts to put them in one blog entry. So, I’ll be blogging over the next few days with my notes, thoughts and reactions for each of the lectures.

Here’s who I got to hear:

Steve Martin, who discussed the art of training and what makes a great trainer. He talked about accepting responsibility for behavior, empowering the animal, motivating the animal, communication and aversives.
My first page of notes about Steve Martin’s talk.
My second page of notes about Steve Martin’s talk.
My third page of notes about Steve Martin’s talk.

Steve White, who talked about the “real world,” and at length about punishment.
My first page of notes about Steve White’s talk.
My second page of notes about Steve White’s talk.

Kay Laurence, who talked about reinforcers and what influences the delivery and effectiveness of a reinforcer.
My first page of notes about Kay Laurence’s talk.
My second page of notes about Kay Laurence’s talk.

Alexandra Kurland

Ken Rameriz

Bob Bailey unfortunately couldn’t come, but Dr. Jesus Rosales-Ruiz read a letter that he had sent.

Be sure to check back tomorrow and later in the week, as I’ll be blogging about the rest of the conference speakers. If you don’t regularly read my blog, but find this interesting, I encourage you to subscribe via the RSS feed or by e-mail subscriptions (both located at the top right. Thanks for reading! ]]> http://stalecheerios.com/blog/horse-training/orca-great-minds-conference-2009/feed/ 12