154

I realize that parameterized SQL queries is the optimal way to sanitize user input when building queries that contain user input, but I'm wondering what is wrong with taking user input and escaping any single quotes and surrounding the whole string with single quotes. Here's the code:

sSanitizedInput = "'" & Replace(sInput, "'", "''") & "'"

Any single-quote the user enters is replaced with double single-quotes, which eliminates the users ability to end the string, so anything else they may type, such as semicolons, percent signs, etc., will all be part of the string and not actually executed as part of the command.

We are using Microsoft SQL Server 2000, for which I believe the single-quote is the only string delimiter and the only way to escape the string delimiter, so there is no way to execute anything the user types in.

I don't see any way to launch an SQL injection attack against this, but I realize that if this were as bulletproof as it seems to me someone else would have thought of it already and it would be common practice.

What's wrong with this code? Is there a way to get an SQL injection attack past this sanitization technique? Sample user input that exploits this technique would be very helpful.


UPDATE:

I still don't know of any way to effectively launch a SQL injection attack against this code. A few people suggested that a backslash would escape one single-quote and leave the other to end the string so that the rest of the string would be executed as part of the SQL command, and I realize that this method would work to inject SQL into a MySQL database, but in SQL Server 2000 the only way (that I've been able to find) to escape a single-quote is with another single-quote; backslashes won't do it.

And unless there is a way to stop the escaping of the single-quote, none of the rest of the user input will be executed because it will all be taken as one contiguous string.

I understand that there are better ways to sanitize input, but I'm really more interested in learning why the method I provided above won't work. If anyone knows of any specific way to mount a SQL injection attack against this sanitization method I would love to see it.

Peter Mortensen
  • 30,738
  • 21
  • 105
  • 131
Patrick
  • 5,970
  • 4
  • 24
  • 21
  • 21
    @BryanH Admitting not to understand how the commonly accepted wisdom applies to a specific case and asking for an example about such specific case is not hubris, it's humbleness. Getting annoyed when someone asks for an example of why the commonly accepted wisdom is right on the other hand might come across as arrogant. Reasoning by specific examples is often a great way to investigate and learn. The way the OP went about this doubt was very useful for my understanding of the subject, especially when he explained the answer he found. – SantiBailors Jun 14 '15 at 10:24
  • @patrik Just came across this as I'm working on the same piece of code but trying to escape the string and nest a query. Did you ever figure it out? – 3therk1ll Sep 20 '19 at 14:26
  • 1
    @3therk1ll it's best not to try, you're better off using parameterized SQL: https://blog.codinghorror.com/give-me-parameterized-sql-or-give-me-death/ – Patrick Sep 20 '19 at 16:12
  • @Patrick, I'm approaching it from the attackers perspective! – 3therk1ll Sep 20 '19 at 17:14

19 Answers19

92

First of all, it's just bad practice. Input validation is always necessary, but it's also always iffy.
Worse yet, blacklist validation is always problematic, it's much better to explicitly and strictly define what values/formats you accept. Admittedly, this is not always possible - but to some extent it must always be done.
Some research papers on the subject:

Point is, any blacklist you do (and too-permissive whitelists) can be bypassed. The last link to my paper shows situations where even quote escaping can be bypassed.

Even if these situations do not apply to you, it's still a bad idea. Moreover, unless your app is trivially small, you're going to have to deal with maintenance, and maybe a certain amount of governance: how do you ensure that its done right, everywhere all the time?

The proper way to do it:

  • Whitelist validation: type, length, format or accepted values
  • If you want to blacklist, go right ahead. Quote escaping is good, but within context of the other mitigations.
  • Use Command and Parameter objects, to preparse and validate
  • Call parameterized queries only.
  • Better yet, use Stored Procedures exclusively.
  • Avoid using dynamic SQL, and dont use string concatenation to build queries.
  • If using SPs, you can also limit permissions in the database to executing the needed SPs only, and not access tables directly.
  • you can also easily verify that the entire codebase only accesses the DB through SPs...
Michael Fredrickson
  • 36,839
  • 5
  • 92
  • 109
AviD
  • 12,944
  • 7
  • 61
  • 91
  • 3
    When used correctly, dynamic SQL and string concatenation can be used safely with parameterized queries (i.e. with `sp_executesql` instead of `EXEC`). That is, you can dynamically generate your SQL statement so long as none of the concatenated text comes from the user. This also has performance benefits; `sp_executesql` supports caching. – Brian Jul 16 '10 at 21:34
  • 2
    @Brian, well duh :). But in reality, how often do you see programmers do that? Moreover, the typical scenario where dynamic SQL is "needed", *requires* the user input as part of the query (supposedly). If you could do sp_executesql, you wouldn't (usually) need the dynamic sql in the first place. – AviD Jul 18 '10 at 15:05
  • 1
    I finally ran into a situation that made me realize that it is possible to use unicode to sneak past the string replacement. The input text was typed into Word, which changed the apostrophe from the straight-down version to a "curly" apostrophe (which looks more like a comma), which was not affected by the string replacement but was treated as a string delimiter by SQL Server. Thanks for the answer AviD (and everyone else)! – Patrick Oct 31 '12 at 04:55
  • @AviD I think what Brian is saying is where the SqlCommand Text doesn't contain input directly from the user. It will instead contain parameter placeholders such as `@name` which can then be set to anything you like without the risk of injection. I am discounting someone building something dumb like `SqlCommand.Text="EXEC(@userinput)"` which would obviously *deserve* to be destroyed. – El Ronnoco Jan 21 '13 at 12:44
  • 1
    @ElRonnoco sure, but I *don't* discount that, since I've seen it in the wild more times than you'd think... – AviD Jan 21 '13 at 14:30
  • The link to the SQL Smuggling PDF is now broken. Can you update the link? – Eric J. Apr 15 '14 at 18:39
  • 1
    @AviD I updated the link to the SQL Smuggling PDF that you wrote to the only version I could find online... please let us know if there's another location for your paper. – Michael Fredrickson Dec 17 '14 at 17:59
  • "Call parameterised queries only": yeah... until you run into `JSON_MODIFY` which ONLY accepts string literals for path. Facedesk... – Roman Starkov Jul 14 '17 at 14:18
  • Its probably worth noting that generally its smart to use ORMs if performance isn't a primary concern, just make sure its a good one (Ie don't use Active Record pattern ones, use Data mappers, and for god sake learn and use database side constraints). The reason for this is generally the people who write the ORMs are *much* more experienced with SQL security and are likely to be recieving vunerability notices and acting on them. Many of these have decent validation frameworks built in, as well as the eternally useful migration systems. – Shayne Apr 16 '19 at 07:02
  • I am using SQL Server. I know about parametrised sql etc but I have edge situation that may need dynamic sql. Access to the input field is highly restricted. If the input is stripped to just A-Z characters (no spaces) is SQL injection possible. Does anyone have examples? – Jake Sep 06 '21 at 21:23
  • I'm sorry, we have just reached a case where all of these are infeasible. It's escape the literal and embed or replace SQL server with a SQL dialect that allows it. – Joshua Nov 20 '21 at 00:02
  • Good information, but how does this address the question?! – Lucas Mumbo Apr 04 '22 at 05:20
44

Okay, this response will relate to the update of the question:

"If anyone knows of any specific way to mount a SQL injection attack against this sanitization method I would love to see it."

Now, besides the MySQL backslash escaping - and taking into account that we're actually talking about MSSQL, there are actually 3 possible ways of still SQL injecting your code

sSanitizedInput = "'" & Replace(sInput, "'", "''") & "'"

Take into account that these will not all be valid at all times, and are very dependant on your actual code around it:

  1. Second-order SQL Injection - if an SQL query is rebuilt based upon data retrieved from the database after escaping, the data is concatenated unescaped and may be indirectly SQL-injected. See
  2. String truncation - (a bit more complicated) - Scenario is you have two fields, say a username and password, and the SQL concatenates both of them. And both fields (or just the first) has a hard limit on length. For instance, the username is limited to 20 characters. Say you have this code:
username = left(Replace(sInput, "'", "''"), 20)

Then what you get - is the username, escaped, and then trimmed to 20 characters. The problem here - I'll stick my quote in the 20th character (e.g. after 19 a's), and your escaping quote will be trimmed (in the 21st character). Then the SQL

sSQL = "select * from USERS where username = '" + username + "'  and password = '" + password + "'"

combined with the aforementioned malformed username will result in the password already being outside the quotes, and will just contain the payload directly.
3. Unicode Smuggling - In certain situations, it is possible to pass a high-level unicode character that looks like a quote, but isn't - until it gets to the database, where suddenly it is. Since it isn't a quote when you validate it, it will go through easy... See my previous response for more details, and link to original research.

AviD
  • 12,944
  • 7
  • 61
  • 91
28

In a nutshell: Never do query escaping yourself. You're bound to get something wrong. Instead, use parameterized queries, or if you can't do that for some reason, use an existing library that does this for you. There's no reason to be doing it yourself.

Nick Johnson
  • 100,655
  • 16
  • 128
  • 198
  • 3
    What if you have to deal with something like "Google Fusion tables" where, afaik, there's no any abstraction library available that supports its dialect? What would you suggest? – systempuntoout Jul 17 '12 at 09:12
  • 1
    The question is not which is wiser, it is about exactly how a particular solution actually fails. If you don't know, then you don't have an answer to this quetion. – Scott Smith Jan 04 '21 at 20:52
22

I realize this is a long time after the question was asked, but ..

One way to launch an attack on the 'quote the argument' procedure is with string truncation. According to MSDN, in SQL Server 2000 SP4 (and SQL Server 2005 SP1), a too long string will be quietly truncated.

When you quote a string, the string increases in size. Every apostrophe is repeated. This can then be used to push parts of the SQL outside the buffer. So you could effectively trim away parts of a where clause.

This would probably be mostly useful in a 'user admin' page scenario where you could abuse the 'update' statement to not do all the checks it was supposed to do.

So if you decide to quote all the arguments, make sure you know what goes on with the string sizes and see to it that you don't run into truncation.

I would recommend going with parameters. Always. Just wish I could enforce that in the database. And as a side effect, you are more likely to get better cache hits because more of the statements look the same. (This was certainly true on Oracle 8)

Jørn Jensen
  • 998
  • 1
  • 10
  • 17
  • 1
    After posting, I decided that AviD's post covers this, and in more detail. Hopefully my post will still be of help to someone. – Jørn Jensen Feb 19 '09 at 11:01
12

I've used this technique when dealing with 'advanced search' functionality, where building a query from scratch was the only viable answer. (Example: allow the user to search for products based on an unlimited set of constraints on product attributes, displaying columns and their permitted values as GUI controls to reduce the learning threshold for users.)

In itself it is safe AFAIK. As another answerer pointed out, however, you may also need to deal with backspace escaping (albeit not when passing the query to SQL Server using ADO or ADO.NET, at least -- can't vouch for all databases or technologies).

The snag is that you really have to be certain which strings contain user input (always potentially malicious), and which strings are valid SQL queries. One of the traps is if you use values from the database -- were those values originally user-supplied? If so, they must also be escaped. My answer is to try to sanitize as late as possible (but no later!), when constructing the SQL query.

However, in most cases, parameter binding is the way to go -- it's just simpler.

Pontus Gagge
  • 17,166
  • 1
  • 38
  • 51
9

Input sanitation is not something you want to half-ass. Use your whole ass. Use regular expressions on text fields. TryCast your numerics to the proper numeric type, and report a validation error if it doesn't work. It is very easy to search for attack patterns in your input, such as ' --. Assume all input from the user is hostile.

tom.dietrich
  • 8,219
  • 2
  • 39
  • 56
  • 4
    And when you miss that **ONE** case on **ONE** input, you're pwnd. – BryanH Nov 18 '12 at 04:02
  • 4
    "Some people, when confronted with a problem, think "I know, I'll use regular expressions." Now they have two problems." – MickeyfAgain_BeforeExitOfSO Dec 05 '13 at 17:27
  • 1
    @mickeyf I know this is a common sentiment but honestly regular expressions are pretty awesome once you grep them. – tom.dietrich Dec 07 '13 at 16:38
  • @tom.dietrich It always depends on the real life situation. F.ex. regexpr syntax is not standard so in general I would advise against using regexpr in contexts where different systems are integrated to work together. This is because different regexpr engines evaluate regexprs differently, and more importantly this hard fact gets usually downplayed or ignored which can lead developers to not care about these incompatibilities until they get bitten. There are plenty of such incompatibilities; see f.ex. http://www.regular-expressions.info/shorthand.html (search for `flavors` in that page). – SantiBailors Jun 15 '15 at 10:48
6

It's a bad idea anyway as you seem to know.

What about something like escaping the quote in string like this: \'

Your replace would result in: \''

If the backslash escapes the first quote, then the second quote has ended the string.

WW.
  • 23,793
  • 13
  • 94
  • 121
  • 3
    Thanks for the response! I know that attack would work for a mySQL database but I'm pretty sure that MS SQL Server won't accept a backslash as an escape character (I tried it). Several google searches did not reveal any other escape characters, which really made me wonder why this wouldn't work. – Patrick Sep 26 '08 at 12:54
6

Simple answer: It will work sometimes, but not all the time. You want to use white-list validation on everything you do, but I realize that's not always possible, so you're forced to go with the best guess blacklist. Likewise, you want to use parametrized stored procs in everything, but once again, that's not always possible, so you're forced to use sp_execute with parameters.

There are ways around any usable blacklist you can come up with (and some whitelists too).

A decent writeup is here: http://www.owasp.org/index.php/Top_10_2007-A2

If you need to do this as a quick fix to give you time to get a real one in place, do it. But don't think you're safe.

Invalid Character
  • 203
  • 1
  • 5
  • 15
6

There are two ways to do it, no exceptions, to be safe from SQL-injections; prepared statements or prameterized stored procedures.

olle
  • 1,196
  • 7
  • 10
4

If you have parameterised queries available you should be using them at all times. All it takes is for one query to slip through the net and your DB is at risk.

Kev
  • 118,037
  • 53
  • 300
  • 385
4

Patrick, are you adding single quotes around ALL input, even numeric input? If you have numeric input, but are not putting the single quotes around it, then you have an exposure.

Rob Kraft
  • 1,122
  • 1
  • 11
  • 18
3

Yeah, that should work right up until someone runs SET QUOTED_IDENTIFIER OFF and uses a double quote on you.

Edit: It isn't as simple as not allowing the malicious user to turn off quoted identifiers:

The SQL Server Native Client ODBC driver and SQL Server Native Client OLE DB Provider for SQL Server automatically set QUOTED_IDENTIFIER to ON when connecting. This can be configured in ODBC data sources, in ODBC connection attributes, or OLE DB connection properties. The default for SET QUOTED_IDENTIFIER is OFF for connections from DB-Library applications.

When a stored procedure is created, the SET QUOTED_IDENTIFIER and SET ANSI_NULLS settings are captured and used for subsequent invocations of that stored procedure.

SET QUOTED_IDENTIFIER also corresponds to the QUOTED_IDENTIFER setting of ALTER DATABASE.

SET QUOTED_IDENTIFIER is set at parse time. Setting at parse time means that if the SET statement is present in the batch or stored procedure, it takes effect, regardless of whether code execution actually reaches that point; and the SET statement takes effect before any statements are executed.

There's a lot of ways QUOTED_IDENTIFIER could be off without you necessarily knowing it. Admittedly - this isn't the smoking gun exploit you're looking for, but it's a pretty big attack surface. Of course, if you also escaped double quotes - then we're back where we started. ;)

Community
  • 1
  • 1
Mark Brackett
  • 84,552
  • 17
  • 108
  • 152
  • 2
    That could work, but again, how could they get that code to execute when all user input is surrounded by single quotes? A specific line(s) of code that would be able to inject SQL into the above code would be very helpful. Thanks! – Patrick Oct 21 '08 at 12:43
3

Your defence would fail if:

  • the query is expecting a number rather than a string
  • there were any other way to represent a single quotation mark, including:
    • an escape sequence such as \039
    • a unicode character

(in the latter case, it would have to be something which were expanded only after you've done your replace)

AJ.
  • 13,461
  • 19
  • 51
  • 63
1

What ugly code all that sanitisation of user input would be! Then the clunky StringBuilder for the SQL statement. The prepared statement method results in much cleaner code, and the SQL Injection benefits are a really nice addition.

Also why reinvent the wheel?

JeeBee
  • 17,476
  • 5
  • 50
  • 60
1

Rather than changing a single quote to (what looks like) two single quotes, why not just change it to an apostrophe, a quote, or remove it entirely?

Either way, it's a bit of a kludge... especially when you legitimately have things (like names) which may use single quotes...

NOTE: Your method also assumes everyone working on your app always remembers to sanitize input before it hits the database, which probably isn't realistic most of the time.

Kevin Fairchild
  • 10,891
  • 6
  • 33
  • 52
  • Down-voted because answer does not address question. Question is about escaping strings in SQL. When you escape an arbitrary string (as the questioner is trying to do, in order to deal with unsanitised data), you can’t just replace problematic characters with arbitrary other ones; that corrupts data. (Also, a single quote IS an apostrophe (at least in ASCII).) – andrewf Jul 21 '16 at 15:02
0

I'm not sure about your case, but I just encountered a case in Mysql that Replace(value, "'", "''") not only can't prevent SQL injection, but also causes the injection. if an input ended with \', it's OK without replace, but when replacing the trailing ', the \ before end of string quote causes the SQL error.

-1

While you might find a solution that works for strings, for numerical predicates you need to also make sure they're only passing in numbers (simple check is can it be parsed as int/double/decimal?).

It's a lot of extra work.

Joseph Daigle
  • 47,650
  • 10
  • 49
  • 73
-2

It might work, but it seems a little hokey to me. I'd recommend verifing that each string is valid by testing it against a regular expression instead.

Rob
  • 25,984
  • 32
  • 109
  • 155
-3

Yes, you can, if...

After studying the topic, I think input sanitized as you suggested is safe, but only under these rules:

  1. you never allow string values coming from users to become anything else than string literals (i.e. avoid giving configuration option: "Enter additional SQL column names/expressions here:"). Value types other than strings (numbers, dates, ...): convert them to their native data types and provide a routine for SQL literal from each data type.

    • SQL statements are problematic to validate
  2. you either use nvarchar/nchar columns (and prefix string literals with N) OR limit values going into varchar/char columns to ASCII characters only (e.g. throw exception when creating SQL statement)

    • this way you will be avoiding automatic apostrophe conversion from CHAR(700) to CHAR(39) (and maybe other similar Unicode hacks)
  3. you always validate value length to fit actual column length (throw exception if longer)

    • there was a known defect in SQL Server allowing to bypass SQL error thrown on truncation (leading to silent truncation)
  4. you ensure that SET QUOTED_IDENTIFIER is always ON

    • beware, it is taken into effect in parse-time, i.e. even in inaccessible sections of code

Complying with these 4 points, you should be safe. If you violate any of them, a way for SQL injection opens.

miroxlav
  • 11,796
  • 5
  • 58
  • 99
  • 1
    It is like you didn't read all the other answers to this **8 year old question**, since any number of these answers point out his method **fails to stop injection** if the attacker simply uses unicode characters. – Hogan Feb 22 '16 at 20:52
  • @Hogan – I did, but I think there is extra value in my question. I have much experience and testing behind what I wrote. I know using query parameters is better, but I also fully understand the situation when someone must avoid it due to various reasons (e.g. employer demands to keep the old way). In this case, I think my answer is very comprehensive and has higher value than answers saying "just don't do that", because it shows the way through. Show me other answers here which show the same way and I'll consider deleting mine. – miroxlav Feb 22 '16 at 20:55
  • Ok, when (not if) your system gets compromised please come back and delete this answer.... or you could use a parametrized query. – Hogan Feb 22 '16 at 20:59
  • @Hogan – I have no problem to do it :) But currently I claim there is no known way to get around this if you keep the 4 rules I posted. If you really think there is a way around it, then just point out where. – miroxlav Feb 22 '16 at 21:24
  • Bad advice hombre. *any* interpolation can be defeated. – Shayne Apr 16 '19 at 07:07
  • @Shayne - any source to back this claim? So I and other readers can learn from it. You comment is not much different from the above ones, which claim that without any source or pointer. – miroxlav Apr 16 '19 at 12:51