Chuck Ebbert b218718
From: Suresh Siddha <suresh.b.siddha@intel.com>
Chuck Ebbert b218718
Date: Mon, 23 Aug 2010 20:42:51 +0000 (-0700)
Chuck Ebbert b218718
Subject: sched: Move sched_avg_update() to update_cpu_load()
Chuck Ebbert b218718
X-Git-Tag: v2.6.36-rc4~8^2~1
Chuck Ebbert b218718
X-Git-Url: http://git.kernel.org/?p=linux%2Fkernel%2Fgit%2Ftorvalds%2Flinux-2.6.git;a=commitdiff_plain;h=da2b71edd8a7db44fe1746261410a981f3e03632
Chuck Ebbert b218718
Chuck Ebbert b218718
sched: Move sched_avg_update() to update_cpu_load()
Chuck Ebbert b218718
Chuck Ebbert b218718
Currently sched_avg_update() (which updates rt_avg stats in the rq)
Chuck Ebbert b218718
is getting called from scale_rt_power() (in the load balance context)
Chuck Ebbert b218718
which doesn't take rq->lock.
Chuck Ebbert b218718
Chuck Ebbert b218718
Fix it by moving the sched_avg_update() to more appropriate
Chuck Ebbert b218718
update_cpu_load() where the CFS load gets updated as well.
Chuck Ebbert b218718
Chuck Ebbert b218718
Signed-off-by: Suresh Siddha <suresh.b.siddha@intel.com>
Chuck Ebbert b218718
Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
Chuck Ebbert b218718
LKML-Reference: <1282596171.2694.3.camel@sbsiddha-MOBL3>
Chuck Ebbert b218718
Signed-off-by: Ingo Molnar <mingo@elte.hu>
Chuck Ebbert b218718
---
Chuck Ebbert b218718
Chuck Ebbert b218718
diff --git a/kernel/sched.c b/kernel/sched.c
Chuck Ebbert b218718
index 09b574e..ed09d4f 100644
Chuck Ebbert b218718
--- a/kernel/sched.c
Chuck Ebbert b218718
+++ b/kernel/sched.c
Chuck Ebbert b218718
@@ -1294,6 +1294,10 @@ static void resched_task(struct task_struct *p)
Chuck Ebbert b218718
 static void sched_rt_avg_update(struct rq *rq, u64 rt_delta)
Chuck Ebbert b218718
 {
Chuck Ebbert b218718
 }
Chuck Ebbert b218718
+
Chuck Ebbert b218718
+static void sched_avg_update(struct rq *rq)
Chuck Ebbert b218718
+{
Chuck Ebbert b218718
+}
Chuck Ebbert b218718
 #endif /* CONFIG_SMP */
Chuck Ebbert b218718
 
Chuck Ebbert b218718
 #if BITS_PER_LONG == 32
Chuck Ebbert b218718
@@ -3182,6 +3186,8 @@ static void update_cpu_load(struct rq *this_rq)
Chuck Ebbert b218718
 
Chuck Ebbert b218718
 		this_rq->cpu_load[i] = (old_load * (scale - 1) + new_load) >> i;
Chuck Ebbert b218718
 	}
Chuck Ebbert b218718
+
Chuck Ebbert b218718
+	sched_avg_update(this_rq);
Chuck Ebbert b218718
 }
Chuck Ebbert b218718
 
Chuck Ebbert b218718
 static void update_cpu_load_active(struct rq *this_rq)
Chuck Ebbert b218718
diff --git a/kernel/sched_fair.c b/kernel/sched_fair.c
Chuck Ebbert b218718
index ab661eb..f53ec75 100644
Chuck Ebbert b218718
--- a/kernel/sched_fair.c
Chuck Ebbert b218718
+++ b/kernel/sched_fair.c
Chuck Ebbert b218718
@@ -2268,8 +2268,6 @@ unsigned long scale_rt_power(int cpu)
Chuck Ebbert b218718
 	struct rq *rq = cpu_rq(cpu);
Chuck Ebbert b218718
 	u64 total, available;
Chuck Ebbert b218718
 
Chuck Ebbert b218718
-	sched_avg_update(rq);
Chuck Ebbert b218718
-
Chuck Ebbert b218718
 	total = sched_avg_period() + (rq->clock - rq->age_stamp);
Chuck Ebbert b218718
 	available = total - rq->rt_avg;
Chuck Ebbert b218718