Unicode Support in Programing Language Function Name and Operator

Unicode Support in Function Name and Operator

The question we want to ask are, does your favorite programing language:

1. Support literal Unicode character in strings? (almost all programing language today (as of 2019) support unicode in string or source code.)
2. Support literal Unicode character in source code? (e.g. in comment.)
3. Allow Unicode character in identifier (variable or function names), e.g. φ = 3; φ(3).
4. Allow Non-letter Unicode character in identifier, e.g. ⊕(v1, v2).
5. Allow defining new operators e.g. x +++ y.
6. Allow defining new operators using unicode symbol e.g. M ⊗ v.

Here is a table showing support of unicode in identifier, and defining operators.

What Characters Are Unicode Letter

Many languages do not allow non-letter e.g. Unicode: Math Symbols π² ∞ ∫ in identifier names. e.g. JavaScript, python, golang, java.

• Unicode Letter Character

Why Define Operators?

• Programing Language Design: Why You Need Operators

Golang

Identifier must start with a Unicode Letter Character, followed by letter or digit.

Unicode math symbols NOT allowed (e.g. ∑ ⊕ °).

package main

import "fmt"

func main() {

	var α = 3

	// var t⊕ = 4
	// syntax error
	// invalid identifier character U+2295 '⊕'

	fmt.Printf("%v\n", α)
}

Python

Python 2

Python 2.x does not support Unicode char for variable or function names.

Python 2.x's Unicode support is not very good. But does work for processing Unicode in string.

Python 3

Supports Unicode in variable names and function names.

Unicode math symbols NOT allowed (e.g. ∑ ⊕ °).

• Python: Allowed Characters in Identifiers

JavaScript

Supports Unicode in variable name and function name.

Unicode math symbols NOT allowed (e.g. ∑ ⊕ °).

• JS: Allowed Characters in Identifier
• JS: Unicode Escape Sequence
• JS: String Code Unit

Ruby

Ruby has robust support of Unicode, starting with version 1.9. (2007)

Unicode can be in variable or function names.

Unicode math symbols NOT allowed (e.g. ∑ ⊕ °).

# -*- coding: utf-8 -*-
# ruby

♥ = "♥"

def λ n
  n + "美"
end

p (λ ♥) == "♥美" # true

• Ruby: Unicode Tutorial 💎

Perl

Perl, since about 5.14 (2011), has good Unicode support.

Supports Unicode in function or variable names.

Unicode math symbols NOT allowed (e.g. ∑ ⊕ °).

• Perl: Allowed Char in Identifiers

Java

Supports Unicode fully, including use in variable/class/method names.

Unicode math symbols NOT allowed (e.g. ∑ ⊕ °).

• Java: Identifier Names with Unicode Characters

Emacs Lisp

For text processing, the most beautiful lang with respect to Unicode is emacs lisp. In elisp, you don't have to declare none of the Unicode or encoding stuff. You simply write code to process string or files, without even having to know what encoding it is. Emacs the environment takes care of all that.

Supports Unicode in function or variable names.

Non-letter unicode math symbol allowed.

(defun ♥ ()
  "Inserts stuff"
  (interactive)
  (let ((α "♥ 愛 ☯"))
    (insert α)))

(to try the above in emacs: paste the above into a empty file, then select it, then Alt+x eval-region to make emacs eval it. Now, you can press Alt+x then type ♥ (just copy paste), it'll insert “♥ 愛 ☯”.) (See: Emacs and Unicode Tips • Emacs Lisp Basics.)

Ocaml

Ocaml does not allow any non-ascii character in names.

Ocaml can define operators, but operators can only be some ASCII chars.

source https://caml.inria.fr/pub/docs/manual-ocaml/names.html#operator-name

Haskell

Haskell allows non-ascii char in variable or function names. but it must be Unicode letter char. Math symbol not allowed.

Haskell can define operator, and the operator can be any unicode character in the category of symbol or punctuation.

Summary: variable or function names must be unicode letter, and operator must be unicode symbol.

source https://www.haskell.org/onlinereport/haskell2010/haskellch2.html#x7-180002.4

Here is haskell user defined operators in action:

Julia

Julia allow Unicode math symbols variable names and also allow defining operators with math symbols.

Wolfram Language

• Wolfram Language allow Non-letter Unicode in identifier, e.g. ♥ = 3.
• Wolfram Language allow defining behaviors of operators, but the operator name/character must be chosen from a given list. e.g. x ⊕ y

Technically, Mathematica source code is ASCII. Characters in Unicode or Mathematica's own set of math symbols are represented by a markup, much like HTML entities. However, Mathematica editor (the Front End) displays it rendered, and there's robust system for user to input math symbols.

• WolframLang: Source Code Encoding and Unicode

Linden Scripting Language (Second Life)

Supports Unicode in variable name and function name.

string a∑♥ = "variable with Unicode char in name";

string t∑♥() { return "function with Unicode char in name";}

default
{
    state_entry()
    {
        llSay(0, "Hello, Avatar!");
    }

    touch_start(integer num_detected)
    {
        llSay(0, (string) t∑♥() + "; " + (string) a∑♥);
    }
}

See:

• Xah's Linden Scripting Language (LSL) Tutorial
• Linden Scripting Language (LSL) Unicode Support

Fortress

• Fortress Programing Language and Unicode

APL etc

APL is well-known for its use of math symbols. 〔see APL Symbols Meaning and Code Example〕 but am not sure if it allows unicode symbol in identifiers or defining operator.

For other programing language language's support of unicode in names, see http://rosettacode.org/wiki/Unicode_variable_names Note: that page does not discuss if math symbol character can be used.

Why Use Unicode in Variable Names?

• Variable Naming: English Words Considered Harmful

Languages and Unicode Support History

• Mathematica. v3 (1996). Major version with typesetting feature.
• Emacs Lisp (2009). Internal encoding is now superset of UTF-8. 〔see New Features in Emacs 23〕
• Linden Scripting Language (LSL)
• Perl 5.12 (2010). Major Unicode overhaul.
• Python 3 (2008). Major Unicode overhaul.
• Ruby 1.9 (2007). Major Unicode overhaul.
• Java 1.5 (2004). Java have always supported Unicode. Its source file encoding are UTF-16 by spec. (in Java 18, source code is now UTF-8)
• JavaScript. ECMA-262, 5.1 edition. Source code is unicode char set, but no encoding is specified. Encoding is dependent on the host system (the web page or HTTP server). JavaScript's strings, are 16 bits byte sequence, not characters. 〔see JavaScript String is 16 Bits Byte Sequence〕
• Python 2. Does not support Unicode in variable or function names.

thanks to boostjam on perl

thanks to Hleb Valoshka on ruby. https://plus.google.com/b/113859563190964307534/105354689506653311797/posts