The name was a bit misleading since libproc_macro is a rust library that
should we should be able to link against some rust code. This cpp
library was the layer below the libproc_macro library, the "real" gcc
libproc_macro act as a translation layer for the internal library.

gcc/rust/ChangeLog:

	* expand/rust-macro-expand.h: Change include directive with the
	new name.
	* expand/rust-proc-macro.h (RUST_PROC_MACRO_H): Likewise.
	* util/rust-hir-map.h: Likewise.
	* util/rust-token-converter.h: Likewise.
	* util/rust-token-converter.cc: Remove useless include
	directive.
	* Make-lang.in: Rename library.

libgrust/ChangeLog:

	* Makefile.am: Change library name.
	* Makefile.in: Likewise.
	* configure.ac: Likewise.
	* configure: Regenerate.
	* libproc_macro/Makefile.am: Moved to...
	* libproc_macro_internal/Makefile.am: ...here.
	* libproc_macro/Makefile.in: Moved to...
	* libproc_macro_internal/Makefile.in: ...here.
	* libproc_macro/bridge.h: Moved to...
	* libproc_macro_internal/bridge.h: ...here.
	* libproc_macro/ffistring.cc: Moved to...
	* libproc_macro_internal/ffistring.cc: ...here.
	* libproc_macro/ffistring.h: Moved to...
	* libproc_macro_internal/ffistring.h: ...here.
	* libproc_macro/group.cc: Moved to...
	* libproc_macro_internal/group.cc: ...here.
	* libproc_macro/group.h: Moved to...
	* libproc_macro_internal/group.h: ...here.
	* libproc_macro/ident.cc: Moved to...
	* libproc_macro_internal/ident.cc: ...here.
	* libproc_macro/ident.h: Moved to...
	* libproc_macro_internal/ident.h: ...here.
	* libproc_macro/literal.cc: Moved to...
	* libproc_macro_internal/literal.cc: ...here.
	* libproc_macro/literal.h: Moved to...
	* libproc_macro_internal/literal.h: ...here.
	* libproc_macro/proc_macro.cc: Moved to...
	* libproc_macro_internal/proc_macro.cc: ...here.
	* libproc_macro/proc_macro.h: Moved to...
	* libproc_macro_internal/proc_macro.h: ...here.
	* libproc_macro/punct.cc: Moved to...
	* libproc_macro_internal/punct.cc: ...here.
	* libproc_macro/punct.h: Moved to...
	* libproc_macro_internal/punct.h: ...here.
	* libproc_macro/registration.h: Moved to...
	* libproc_macro_internal/registration.h: ...here.
	* libproc_macro/rust/bridge.rs: Moved to...
	* libproc_macro_internal/rust/bridge.rs: ...here.
	* libproc_macro/rust/bridge/ffistring.rs: Moved to...
	* libproc_macro_internal/rust/bridge/ffistring.rs: ...here.
	* libproc_macro/rust/bridge/group.rs: Moved to...
	* libproc_macro_internal/rust/bridge/group.rs: ...here.
	* libproc_macro/rust/bridge/ident.rs: Moved to...
	* libproc_macro_internal/rust/bridge/ident.rs: ...here.
	* libproc_macro/rust/bridge/literal.rs: Moved to...
	* libproc_macro_internal/rust/bridge/literal.rs: ...here.
	* libproc_macro/rust/bridge/punct.rs: Moved to...
	* libproc_macro_internal/rust/bridge/punct.rs: ...here.
	* libproc_macro/rust/bridge/span.rs: Moved to...
	* libproc_macro_internal/rust/bridge/span.rs: ...here.
	* libproc_macro/rust/bridge/token_stream.rs: Moved to...
	* libproc_macro_internal/rust/bridge/token_stream.rs: ...here.
	* libproc_macro/rust/group.rs: Moved to...
	* libproc_macro_internal/rust/group.rs: ...here.
	* libproc_macro/rust/ident.rs: Moved to...
	* libproc_macro_internal/rust/ident.rs: ...here.
	* libproc_macro/rust/lib.rs: Moved to...
	* libproc_macro_internal/rust/lib.rs: ...here.
	* libproc_macro/rust/literal.rs: Moved to...
	* libproc_macro_internal/rust/literal.rs: ...here.
	* libproc_macro/rust/punct.rs: Moved to...
	* libproc_macro_internal/rust/punct.rs: ...here.
	* libproc_macro/rust/span.rs: Moved to...
	* libproc_macro_internal/rust/span.rs: ...here.
	* libproc_macro/rust/token_stream.rs: Moved to...
	* libproc_macro_internal/rust/token_stream.rs: ...here.
	* libproc_macro/span.cc: Moved to...
	* libproc_macro_internal/span.cc: ...here.
	* libproc_macro/span.h: Moved to...
	* libproc_macro_internal/span.h: ...here.
	* libproc_macro/tokenstream.cc: Moved to...
	* libproc_macro_internal/tokenstream.cc: ...here.
	* libproc_macro/tokenstream.h: Moved to...
	* libproc_macro_internal/tokenstream.h: ...here.
	* libproc_macro/tokentree.cc: Moved to...
	* libproc_macro_internal/tokentree.cc: ...here.
	* libproc_macro/tokentree.h: Moved to...
	* libproc_macro_internal/tokentree.h: ...here.

Signed-off-by: Pierre-Emmanuel Patry <pierre-emmanuel.patry@embecosm.com>

The function to get a literal from a string missed an implementation.
It did require a conversion function to achieve it, now that callback
system has been merged this function can be easily implemented.

gcc/rust/ChangeLog:

	* expand/rust-proc-macro.cc (literal_from_string): Add callback
	function.
	(load_macros_array): Likewise.

libgrust/ChangeLog:

	* libproc_macro/literal.cc (Literal__from_string): Add
	implementation with call to constructor.
	(Literal::make_literal): Add new constructor which calls the
	callback.
	* libproc_macro/literal.h: Add new constructor's
	prototype.
	* libproc_macro/proc_macro.cc (bridge_is_available):
	Change symbol name to match convention.
	* libproc_macro/registration.h: Add lit_from_str
	symbol.
	* libproc_macro/tokenstream.cc (TokenStream::make_tokenstream):
	Change symbol name to disambiguate with literal from string.

Signed-off-by: Pierre-Emmanuel Patry <pierre-emmanuel.patry@embecosm.com>

The symbol had a different convention from rust standard naming
convention (?) hence the change before adding new callback.

gcc/rust/ChangeLog:

	* expand/rust-proc-macro.cc (load_macros_array): Symbol rename.

libgrust/ChangeLog:

	* libproc_macro/proc_macro.cc (Procmacro::make_bang):
	Change symbol name.
	* libproc_macro/registration.h: Likewise.
	* libproc_macro/tokenstream.cc (TokenStream::make_tokenstream): Likewise.

Signed-off-by: Pierre-Emmanuel Patry <pierre-emmanuel.patry@embecosm.com>

Recent changes in the rust interface on some extern C function shall be
synced up in the C++ library.

libgrust/ChangeLog:

	* libproc_macro/literal.cc (Literal__from_string):
	Update to match rust interface.
	* libproc_macro/literal.h (Literal__from_string):
	Likewise.
	* libproc_macro/tokenstream.cc (TokenStream__from_string):
	Likewise.
	* libproc_macro/tokenstream.h (TokenStream__from_string):
	Likewise.

Signed-off-by: Pierre-Emmanuel Patry <pierre-emmanuel.patry@embecosm.com>

Add a callback registration function into the proc macro library so the
compiler can register it's own lexing/parsing functions on load.

gcc/rust/ChangeLog:

	* expand/rust-proc-macro.cc (tokenstream_from_string): Add a
	function that creates a tokenstream from a given string.
	(load_macros_array): Add call to registration function.

libgrust/ChangeLog:

	* libproc_macro/proc_macro.cc (proc_macro_register_from_str):
	Add registration function.
	* libproc_macro/proc_macro.h (proc_macro_register_from_str):
	Add registration function prototype.
	* libproc_macro/tokenstream.cc (TokenStream::make_tokenstream):
	Add a new constructor from a string that uses the registered
	callback.
	(TokenStream__from_string): Add call to new constructor.
	* libproc_macro/tokenstream.h: Add registration
	declaration.
	* libproc_macro/registration.h: New file.

Signed-off-by: Pierre-Emmanuel Patry <pierre-emmanuel.patry@embecosm.com>

TokenStream did not copy back enough old data to the new location. This
commit also add more explicit memcpy usages in order to facilitate
change to utf-8 later.

libgrust/ChangeLog:

	* libproc_macro/ffistring.cc (FFIString::make_ffistring):
	Add explicit sizeof and utf-8 warning.
	(FFIString::clone): Add explicit sizeof and utf-8 warning.
	* libproc_macro/ident.cc (Ident::clone): Likewise.
	(Ident::make_ident): Likewise.
	* libproc_macro/tokenstream.cc (TokenStream::grow):
	Fix vector growth.
	(TokenStream__clone): Add explicit sizeof.

Signed-off-by: Pierre-Emmanuel Patry <pierre-emmanuel.patry@embecosm.com>

The capacity was not updated on tokenstream grow. This commit also add a
new mechanism to prevent a tokenstream to grow with a zero delta capacity.

libgrust/ChangeLog:

	* libproc_macro/tokenstream.cc (TokenStream::grow): Add
	minimum growing capacity.
	(TokenStream::push): Change condition.

Signed-off-by: Pierre-Emmanuel Patry <pierre-emmanuel.patry@embecosm.com>

Either move the elements from their namespace up to the procmacro
namespace or make the namespace anonymous.

libgrust/ChangeLog:

	* libproc_macro/group.cc (Group::make_group): Remove
	internal namespace.
	(Group::drop): Likewise.
	* libproc_macro/group.h (enum Delimiter): Make members
	upercase.
	(struct Group):
	* libproc_macro/ident.cc (Ident::drop): Remove internal
	namespace.
	* libproc_macro/ident.h (Ident__clone): Likewise.
	* libproc_macro/literal.cc (Literal::make_isize):
	Likewise.
	* libproc_macro/literal.h (union LiteralPayload):
	Likewise.
	(Literal__from_string): Likewise.
	* libproc_macro/punct.cc (Punct::make_punct): Likewise.
	* libproc_macro/punct.h (enum Spacing): Make members
	uppercase.
	* libproc_macro/tokenstream.cc (TokenStream::make_tokenstream):
	Remove internal namespace.
	(TokenStream::grow): Likewise.
	(TokenStream::push): Likewise.
	(TokenSream__push): Likewise.
	(TokenStream__clone): Likewise.
	(TokenStream__drop): Likewise.
	* libproc_macro/tokenstream.h (struct TokenStream):
	Likewise.
	(TokenSream__push): Likewise.
	(TokenStream__drop): Likewise.
	* libproc_macro/tokentree.cc (TokenTree::make_tokentree):
	Likewise.
	(TokenTree::drop): Likewise.
	* libproc_macro/tokentree.h (union TokenTreePayload):
	Likewise.

Signed-off-by: Pierre-Emmanuel Patry <pierre-emmanuel.patry@embecosm.com>

Put all functions and structures in a Procmacro namespace to avoid
spilling names in any other namespace.

libgrust/ChangeLog:

	* libproc_macro/group.cc (Group::drop): Add Procmacro
	namespace.
	* libproc_macro/group.h: Likewise.
	* libproc_macro/ident.cc (Ident::drop): Likewise.
	* libproc_macro/ident.h (Ident__clone): Likewise.
	* libproc_macro/literal.cc (Literal::make_isize):
	Likewise.
	* libproc_macro/literal.h (Literal__from_string):
	Likewise.
	* libproc_macro/punct.cc (Punct::make_punct): Likewise.
	* libproc_macro/punct.h: Likewise.
	* libproc_macro/tokenstream.cc (TokenStream__drop):
	Likewise.
	* libproc_macro/tokenstream.h (TokenStream__drop):
	Likewise.
	* libproc_macro/tokentree.cc (TokenTree::drop):
	Likewise.
	* libproc_macro/tokentree.h: Likewise.

Signed-off-by: Pierre-Emmanuel Patry <pierre-emmanuel.patry@embecosm.com>

Remaining structures from the rust bridge that missed a drop function
now have one.

libgrust/ChangeLog:

	* libproc_macro/group.cc (Group::drop): Add drop
	implementation.
	* libproc_macro/group.h: Add drop prototype.
	* libproc_macro/tokenstream.cc (TokenStream::drop): Add
	drop implementation.
	(TokenStream__drop): Change to a call to TokenStream::drop.
	* libproc_macro/tokenstream.h: Add drop prototype.
	* libproc_macro/tokentree.cc (TokenTree::drop): Add
	drop implementation.
	* libproc_macro/tokentree.h: Add drop prototype.

Signed-off-by: Pierre-Emmanuel Patry <pierre-emmanuel.patry@embecosm.com>