Democratic Underground Latest Greatest Lobby Journals Search Options Help Login
Google

Too much reliance on high stakes testing...Many NYC kids have world turned upside down.

Printer-friendly format Printer-friendly format
Printer-friendly format Email this thread to a friend
Printer-friendly format Bookmark this thread
This topic is archived.
Home » Discuss » Archives » General Discussion (1/22-2007 thru 12/14/2010) Donate to DU
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 11:36 AM
Original message
Too much reliance on high stakes testing...Many NYC kids have world turned upside down.
Edited on Sun Aug-01-10 12:16 PM by madfloridian
Amidst all the shouts of accountability coming from the Bloomberg and Klein administration in NYC, we find they have not been accountable to the public. The parents are confused, and the students are suffering from the way in which testing standards were manipulated through the years.

Suddenly students who thought they were succeeding, are not. The huge gains in test scores claimed by Bloomberg and his buddy Joel Klein....were not there after all.

The ones caught in the middle of all the educational politics, the ones paying the price for the changing standards and reliance on one test are the students.

The Incongressional blog quotes the New York Times on the topic.

New York State education officials, admitting that the state’s annual tests were not properly measuring student proficiency, released results Wednesday showing that more than half of New York City students were failing to meet state standards in reading, at a time when Mayor Michael R. Bloomberg boasted that more that more than two-thirds of city’s students were reading at grade level.

After researchers concluded that the state exams had steadily become easier to pass, state officials said last week that they would recalibrate the way the tests were graded, warning educators to brace themselves for a harsh wake-up call.

New York City officials said that if the passing rates since 2006 were adjusted to match the new scoring standards, the city had shown substantial progress over all. But that explanation is likely to offer little consolation to teachers and parents who must now face the reality that just more than half of city students in the third through eighth grades are proficient in math, not four out of every five, as they were led to believe last year.


Fred Klonsky's blog about teacher training in faculty meetings really hit a chord with me. He is writing about the "Accountability" and the irony of the president's speech to the Urban League coming just a day after the test score fiasco hit the news.

Accountability

As I read President Obama’s speech to the Urban League yesterday I just kept thinking: Huh?

It reminded me of staff development meetings at work. Every couple of years the administration brings in some consultant and inevitably we do the “which color are you?” thing. Or the “which direction are you?”

“Green” = individualist. “East” = Good at collaboration. A good 90 minutes of staff development time wasted. 90 minutes of your life you won’t get back. And when it’s done the obvious question is: What does this have to do with anything?


Oh, yeh, I remember the inservice trainings through the years. Some of ours were so ridiculous that I was embarrassed to be there. We had to wear signs of various steps in teaching, we had to move in order of presentation or be moved by a so-called monitor. We had to role-play parents, teachers, and students. I hated it. The presenter was always so gushy. We needed to be having serious training or else be allowed to work in our classrooms.

More from Klonsky's blog:

Other than blaming teachers for not being good with change, was this really a defense of Race to the Top, of competitive grants, of the wholesale closing of schools, of turnaround demands that end up firing good principals and good teachers? Did his speech address the issues raised by the report of the seven Civil Rights Organizations and the critique of Race to the Top that came out of the NEA RA?

Hell no.


This was also covered by Juan Gonzalez at the New York Daily News. The article pointed out that kids were the big losers in the test scores game

So all those glowing school test results were a fraud, after all.

For years, Mayor Bloomberg, Schools Chancellor Joel Klein and top education officials in Albany touted big jumps in math and reading scores statewide - and skyrocketing results among New York City's pupils.

The scores, they said, were proof that mayoral control and Klein's data-driven version of school reform had succeeded. Schools were winning the "civil rights battle of our time," the chancellor claimed, by closing the racial "achievement gap."

.."Now, state officials have revealed a startling nosedive in test scores. Admitting that results from previous years had been inflated, the state announced tougher standards this year - resulting in the lower scores. Thousands of parents who had been told their children were at grade level are suddenly learning they aren't.


So does that mean they are not at grade level? Or does it mean the test standards have been raised and lowered so much that no one really knows what is grade level anymore?

Al Sharpton has been very much on board with Bloomberg and Klein and the mayoral control idea. Now he has second thoughts.

The new scores are so bad Sharpton has begun to distance himself from Klein. "I'm very disturbed and concerned by these scores," Sharpton said.

"We were told students were improving, but it seems our kids were victims of dumbed-down tests to make the administration look good."


Scores are also way down at charter schools. Not just traditional public schools.

Charter schools show alarming drop in pass rate.

Pass rates at city charter schools dropped even more dramatically than at public schools on the state reading exam - by 34 percentage points - a Daily News analysis shows.

As the state moved to raise the bar for achieving a "proficient" rating on the exams, charter schools fell as sharply as public schools on the math exams - by 28 percentage points.


I really think the NYC Public School Parents blog said it best of all.

It's not about the tests.

Standardized test scores have become the scourge of the American education system. In New York, simply reconstructing the exams and raising the cut scores will do nothing more than address a symptom, one reflected in overly generous assessment of students' academic progress and readiness. While the change is needed, it will also conveniently eliminate a major structural criticism of the current education reform movement that those "reformers" will be happy to see removed; it's not for nothing that the New York Times, NY Daily News, and NY Post editorial boards jumped on the "revise the NYS standardized exam bandwagon" so quickly and enthusiastically. That alone should warn everyone of the underlying reality of this situation and their agenda. To wit: test, test, and test some more; measure, measure, and measure some more; incentivize and otherwise hold teachers, principals, and entire schools accountable based on those results.

The yardstick may end up being different, but schools will still be driven toward all the ills of score inflation. As long as people like Joel Klein insist that a single, annual exam (or any number or combination of exams) can determine everything from a child's readiness to a teacher's worthiness to a principal's evaluation to whether a school should be closed, the institutionalized response will inevitably lead to the same place we're at today: score inflation, teaching to the test, altering curricula and classroom time allotments to what is being measured and to the detriment of everything else, favoring repetition and drill over exploration and creativity, systemic cheating, manipulation of data, etc.


Read that second paragraph twice.

As long as one test determines a child's readiness, a teacher's worthiness, a principal's ability, whether or not a school should be closed....then there will be some sort of manipulation at some level. Whether charter or public or private...

Edit to add a link to the NYT article today called When 81% Passing Suddenly Becomes 18%

The world of NYC students and parents has been turned upside down.

It is happening around the country as well.
Printer Friendly | Permalink |  | Top
villager Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 11:40 AM
Response to Original message
1. How do we break the back of test mania? As a parent, I hate it...
...and it always keeps me looking for educational alternatives from my kids...
Printer Friendly | Permalink |  | Top
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 12:00 PM
Response to Original message
2. NYT today: "When 81% Passing Suddenly Becomes 18%"
Edited on Sun Aug-01-10 12:11 PM by madfloridian
And may I say this testing and one-size-fits-all fever is not just hurting NYC kids....it is having a huge impact all over the country. Kids are losing confidence in their ability, parents are frustrated, teachers are considered failing, and principals who devoted themselves to a school are fired.

This is from the NYT today.

When 81% Passing Suddenly Becomes 18%

LINDA L. SINGER, the principal of Public School 255 in Gravesend, Brooklyn, has some phone calls she is dreading to make. Among them: informing 10 families that their children, scheduled to enroll in gifted programs, will no longer qualify, because of new, tougher grading on state English and math exams. And letting the rest of the teachers know that their A-graded school, which had shown consistent progress for years, plunged to a 65 percent passing rate in English, from 85 percent, according to standardized scores released last week.

“When I got these scores I thought I would die,” Ms. Singer said, echoing the feeling in many principals’ offices throughout the city. “Everything is changed.”

There were large drops in passing rates across New York, reflecting new requirements intended to correct for years of inflated results. The exams, state education officials said, had become too easy to pass, their definition of proficiency no longer meaningful. Citywide, the proficiency rate in English fell to 42 percent, from 69 percent last year; 54 percent reached grade level in math, down from 82 percent.

As the plummeting scores sunk in, principals planned strategy and contemplated the unraveling of other achievements, which they were suddenly informed were illusory. In New York City, where test scores are the cornerstone of school accountability, the new numbers, principals feared, could mean the end of their A grades from the Department of Education; a rise in negative teacher performance reviews, which are based partly on state tests; and substandard principal performance reviews.


More:

At some schools, the drop was breathtaking. At Public School 85 in the Bronx, known as the Great Expectations School, there was a literal reversal in fortune, with proficiency on the third-grade math test flipping from 81 percent to 18 percent. At the main campus of the Harlem Promise Academy, one of the city’s top-ranked charter schools, proficiency in third-grade math dropped from 100 percent to 56 percent.


Printer Friendly | Permalink |  | Top
 
Beartracks Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 06:16 PM
Response to Reply #2
24. This notion of "one test" - where did it come from?
> "As long as one test determines a child's readiness, a teacher's worthiness, a principal's ability, whether or not a school should be closed....then there will be some sort of manipulation at some level. Whether charter or public or private..."

Do actual educators come up with this stuff, or is it people who couldn't cut it in the classroom and gravitated into "management"?

Just curious. The notion that one test can do all that sounds ludicrous, and defies common sense; the product of wishful thinking of folks who sure wish life was simpler than what it really is.

-----------------------------
Printer Friendly | Permalink |  | Top
 
Angry Dragon Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 06:36 PM
Response to Reply #24
26. From everything I have read about the change in how we
do education in this country, Obama and duncan leading the charge, is that they look at it as manufacturing.

The people they are putting in charge are managers and they look at it as having to produce a product. The children are raw material and the learning is just bits and pieces they add to the raw material. Set schools up as factories and everything should be fine. The main thing they are neglect to look at is that all children are different, they all think differently.

In a factory one is able to reject raw material that is flawed. Do they plan to do this with children when they fall behind, or are they going to spend the extra time to help those students??

The American people are being sold a product that is not guaranteed. I look at the situation as the dumbing down of American youth.
Printer Friendly | Permalink |  | Top
 
Beartracks Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 06:53 PM
Response to Reply #26
27. "Dumbing down" -- probably so.
To make sure all the "products" meet the standards in this case, you'd have to relax the standards.

It's like redefining "poverty" so you can say we're "winning the war on poverty" -- in essence, we seem to redefining what "educated" means... and it looks something like "edgumacated."

:(

--------------------------
Printer Friendly | Permalink |  | Top
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 12:56 PM
Response to Original message
3. Gifted one minute, not gifted the test. That is just absurd.
I just sounded off on this when the DNC called today. I really got an argument from the guy who said he was working in education for almost 5 years and thought all was fine. I reminded him that Bloomberg having total control of schools as mayor was Arne's idea and the Obama backs Arne 100%. I also told him my 33 years beat his 5 years.

He kept arguing I hung up.

Read:

When 81% Passing Suddenly Becomes 18%

Printer Friendly | Permalink |  | Top
 
malletgirl02 Donating Member (938 posts) Send PM | Profile | Ignore Sun Aug-01-10 01:47 PM
Response to Reply #3
9. People with little teaching experience
I think the problem is that many school districts are being taken over by people with little teaching experience. I think Michelle Rhee for example had only been teaching for 2-3 years.
Printer Friendly | Permalink |  | Top
 
Starry Messenger Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 12:59 PM
Response to Original message
4. Oops
Edited on Sun Aug-01-10 01:26 PM by Starry Messenger
My computer burped.
Printer Friendly | Permalink |  | Top
 
Starry Messenger Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 01:00 PM
Response to Original message
5. I started reading "Making The Grade" last month.
I think you recommended it, madfloridian. It made me so pissed after about 3 chapters I had to put it aside for a while. These tests are a scam people!
Printer Friendly | Permalink |  | Top
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 01:07 PM
Response to Reply #5
6. Gifted one minute, and not the next. Capable one minute, not the next.
It is totally and completely absurd.

Printer Friendly | Permalink |  | Top
 
Starry Messenger Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 01:27 PM
Response to Reply #6
7. And careers and lives are being torn apart over this farce!
It's like something out of a dystopian movie like "Brazil".
Printer Friendly | Permalink |  | Top
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 01:30 PM
Response to Reply #7
8. It's stupid and I get angrier every minute.
Why aren't NYC parents and parents throughout the country fighting this testing pressure? I used to see kids vomiting over these tests, crying....and that was before the high-stakes really got bad.

I can not imagine how it feels to be considered capable one minute and not the next.
Printer Friendly | Permalink |  | Top
 
w8liftinglady Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 01:49 PM
Response to Original message
10. the Democratic governor's candidate in Texas is seeking to do away with this
Printer Friendly | Permalink |  | Top
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 01:51 PM
Response to Reply #10
11. Thanks, I did not realize that.
Good for him.
Printer Friendly | Permalink |  | Top
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 03:54 PM
Response to Original message
12. Ravitch at Huff Post: Obama and Duncan heading in wrong direction.
http://www.huffingtonpost.com/diane-ravitch/obamas-race-to-the-top-wi_b_666598.html

"Furthermore, charter schools on average do not get better results than regular public schools, yet Obama and Duncan are pushing them hard. Duncan acknowledges that there are many mediocre or bad charter schools, but chooses to believe that in the future, the new charters will only be high performing ones. Right.

The President should re-examine his reliance on standardized testing to identify the best teachers and schools and the worst teachers and schools. The tests are simply not adequate to their expectations.

..."But now that the truth about score inflation is out, Mayor Bloomberg and Chancellor Klein steadfastly insist that the gains recorded on their watch did not go up in smoke, that progress was real, and they have reiterated this message through their intermediaries in the tabloids. In other words, they are using every possible rationalization and excuse to avoid accountability for the collapse of their "historic gains."

Meanwhile Secretary Duncan travels the country urging districts to adopt mayoral control, so they can emulate New York City. He carefully avoids mentioning Cleveland, which has had mayoral control for years and remains one of the lowest performing districts in the nation. Nor does he mention that Detroit had mayoral control and ended it. And it is hard to imagine that anyone would think of Chicago, which has been controlled by Mayor Richard Daley for many years, would serve as a national model.

President Obama and Secretary Duncan need to stop and think. They are heading in the wrong direction. On their present course, they will end up demoralizing teachers, closing schools that are struggling to improve, dismantling the teaching profession, destabilizing communities, and harming public education."
Printer Friendly | Permalink |  | Top
 
Jakes Progress Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 04:22 PM
Response to Original message
13. I'm going to give up.
Even DU'ers are joining the NYT in blaming lazy union teachers for test scores and never asking themselves what is on the test, whether it is reliable, whether it proves anything. I was at one assessment conference where someone told us that good assessment wasn't the goal, that a number just takes away parents' ability to think. Just say 82 or 91 or 67 and they buy those numbers as if they mean something.

You are doing a wonderful job of explaining and pointing out the insanity of losing our schools because of a Democratic president, but if we can't even get liberals to ignore the neocon sponsored MSM drumbeat, I don't think the kids have a chance. We've been sold. Whether it was greed or ignorance won't make a difference, but our administration is going the wrong way and won't be persuaded by logic or common sense or morality. arne plays basketball and gets to run the ed department. His jump shot is the only qualification he has, but Obama seems to think he is brilliant. Obama is just a gullible fool who won't examine his own decisions. He is just as convinced of his absolute perfection as was george.
Printer Friendly | Permalink |  | Top
 
proud2BlibKansan Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 04:27 PM
Response to Reply #13
14. +1
Printer Friendly | Permalink |  | Top
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 04:57 PM
Response to Reply #13
17. Until they admit there is serious damage going on in education...
then nothing we say matters.

We just keep saying it, though.
Printer Friendly | Permalink |  | Top
 
LWolf Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 04:58 PM
Response to Reply #13
18. Please don't.
Teachers can't change this mad elephant stampeding through our schools and classrooms alone. Remember, we've been cast as the "enemy." Without the general public to stand up with us in force, it's going to continue rampaging until there's nothing left of public education.
Printer Friendly | Permalink |  | Top
 
Dappleganger Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 06:19 PM
Response to Reply #13
25. Please don't give up.
As a parent with four kids in the public school system (one just graduated) I am begging you to not give up bringing light to this situation.

I am standing with you and MF...these reports are very depressing but our children are worth fighting for! They depend upon us for their futures and they cannot fight for themselves.
Printer Friendly | Permalink |  | Top
 
YvonneCa Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 04:48 PM
Response to Original message
15. Vindication. Check out the other articles on the subject at the NYT link...
Edited on Sun Aug-01-10 04:53 PM by YvonneCa
...here:


http://www.nytimes.com/2010/07/29/education/29scores.html?fta=y

http://www.nytimes.com/2010/07/30/nyregion/30tests.html?fta=y


This totally discredits what is happening in ed. reform by trying to hold NYC up as the model to follow. It also gives more proof to the idea that holding teachers accountable by test scores is unfair...suppose they fired teachers based on such horrible data.

Quoting the second article:

"The new results, Mr. Tobias said, “are vindication for every cautious critic who has warned against using the test for accountability purposes.”

Aaron M. Pallas, a professor of sociology and education at Teachers College at Columbia University, said, “I think the message is: We just really can’t trust the state tests for judging whether the quality of education in New York City has really improved.”

Printer Friendly | Permalink |  | Top
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 04:55 PM
Response to Reply #15
16. There is improvement in spite of the test scores. Interesting link.
"That will be a balm for experts who complained that the real problem with the new scores was that the tests were carrying too much importance as indicators of progress.

The new results, Mr. Tobias said, “are vindication for every cautious critic who has warned against using the test for accountability purposes."


Aaron M. Pallas, a professor of sociology and education at Teachers College at Columbia University, said, “I think the message is: We just really can’t trust the state tests for judging whether the quality of education in New York City has really improved.”

One such test no matter what state is indicative of very little indeed.

It does not measure depth of learning, just pass or fail on a set of answers on one test.

Printer Friendly | Permalink |  | Top
 
YvonneCa Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 05:13 PM
Response to Reply #16
19. What else are they going to say? They've been...
...caught red-handed. They had to know the standards were low. THEY are the ones who have been telling lies to kids and their families...not educators. Now they have 'egg on their faces'...rightfully.

All these cities are putting the cart before the horse...blaming teachers and trying to convince people that teachers are incompetent and not accountable (when most are quite competenent and already accountable) in order to institute the changes that politicians want. The ONLY WAY that can be fair is to take the time to get the testing processes...in every district in every state...fixed first. Only then should we even be TALKING about using any of this data to evaluate teachers.
Printer Friendly | Permalink |  | Top
 
SoCalDem Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 05:19 PM
Response to Original message
20. The ultimate irony? It probably all doesn't matter much anyway
Edited on Sun Aug-01-10 05:20 PM by SoCalDem
Get straight As, go to college, graduate with 30K of debt & end up with a $12hr job

Get C's, barely graduate, get a dead end job at BigBoxStore,Inc or FastJunkFood,Inc for $8hr (but you have no massive college debt)

Drop out, do odd jobs for $6-7hr, have plenty of "free time", but you probably couch-surf for decades (you also do not accumulate 2 tons of "stuff" which you have to haul around with you)
Printer Friendly | Permalink |  | Top
 
Starry Messenger Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 05:23 PM
Response to Original message
21. Did you see this mad?
Maybe you can use it in an OP some time. Whitney Tilson is my pet hate after Duncan & Rhee, I don't know if anyone else is really interested in him, but this raised an eyebrow, Klein emailing Tilson about message control over the NYT article:

http://nycpublicschoolparents.blogspot.com/2010/07/kleins-confidential-email-blasting.html

Printer Friendly | Permalink |  | Top
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 05:59 PM
Response to Reply #21
22. As damning as the mails between Klein and Eva Moskowitz.
Someone needs to keep Klein away from the computer. :rofl:
Printer Friendly | Permalink |  | Top
 
Starry Messenger Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 06:15 PM
Response to Reply #22
23. For reals!
If the man can't even manage to keep his email secure, he sure shouldn't have the massive amount of responsibility he has! But I'm glad people keep catching him. :D What a maroon!
Printer Friendly | Permalink |  | Top
 
Jefferson23 Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 07:41 PM
Response to Original message
28. I have bookmarked this thread, has there been any response from
Edited on Sun Aug-01-10 07:43 PM by Jefferson23
our colleges and universities to this travesty taking place?


It might help if they would speak out, Duncan can't fire them.

Printer Friendly | Permalink |  | Top
 
Jakes Progress Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Aug-01-10 10:20 PM
Response to Reply #28
29. I'm afraid
that colleges like to look down on public school teachers too. They like to say that they could do a better job if only public school teachers did theirs. Makes for a convenient scapegoat.

Of course, I know some who don't play that game, but they tend to be in education depts. Sorry to tar them with this broad brush, but as you can see, they aren't out there helping. Those that would help are usually not the ones other college teachers pay attention to.
Printer Friendly | Permalink |  | Top
 
Jefferson23 Donating Member (1000+ posts) Send PM | Profile | Ignore Mon Aug-02-10 04:51 PM
Response to Reply #29
30. That is sad and regrettable, they should be allies. n/t
Printer Friendly | Permalink |  | Top
 
erodriguez Donating Member (532 posts) Send PM | Profile | Ignore Tue Aug-03-10 09:53 PM
Response to Original message
31. Thanks for the shout out MF
Printer Friendly | Permalink |  | Top
 
madfloridian Donating Member (1000+ posts) Send PM | Profile | Ignore Tue Aug-03-10 09:56 PM
Response to Reply #31
32. Hey, most welcome.
:hi:
Printer Friendly | Permalink |  | Top
 
DU AdBot (1000+ posts) Click to send private message to this author Click to view 
this author's profile Click to add 
this author to your buddy list Click to add 
this author to your Ignore list Thu May 02nd 2024, 01:05 PM
Response to Original message
Advertisements [?]
 Top

Home » Discuss » Archives » General Discussion (1/22-2007 thru 12/14/2010) Donate to DU

Powered by DCForum+ Version 1.1 Copyright 1997-2002 DCScripts.com
Software has been extensively modified by the DU administrators


Important Notices: By participating on this discussion board, visitors agree to abide by the rules outlined on our Rules page. Messages posted on the Democratic Underground Discussion Forums are the opinions of the individuals who post them, and do not necessarily represent the opinions of Democratic Underground, LLC.

Home  |  Discussion Forums  |  Journals |  Store  |  Donate

About DU  |  Contact Us  |  Privacy Policy

Got a message for Democratic Underground? Click here to send us a message.

© 2001 - 2011 Democratic Underground, LLC