lestes::lang::cplus::lex::concat Class Reference

Token concatenator. More...

#include <concat.hh>

Inheritance diagram for lestes::lang::cplus::lex::concat:

List of all members.

Public Types
typedef char	char_type
	Type of character in flex.
typedef int	size_type
	Type of size in flex.
Public Member Functions
virtual	~concat (void)
	Finalizes object.
size_type	yy_input (char_type *cbuf, size_type max)
	Stores next characters for YY_INPUT.
ptr< token_sequence >	process (const ptr< pp_token > &left, const ptr< pp_token > &right)
	Performs token concatenation.
Static Public Member Functions
static ptr< concat >	instance (void)
	Returns the only instance.
Protected Member Functions
	concat (void)
	Creates the object.
virtual void	gc_mark (void)
	Marks the object.
Private Types
typedef concat_guts::yy_buffer_state *	yy_buffer_type
	Type of flex buffer.
Private Member Functions
	concat (const concat &copy)
	Hides copy constructor.
concat &	operator= (const concat &rhs)
	Hides assignment operator.
Private Attributes
yy_buffer_type	yy_buffer
	Flex buffer.
ucn_string	value
	Current value of input string.
ucn_string::size_type	index
	Current index in the input.
ucn_string::size_type	length
	Current length of the input.
Static Private Attributes
static ptr< concat >	singleton
	The only instance.

---

Detailed Description

Token concatenator.

Performs token concatenation. Handles integration with concat_guts flexer.

Definition at line 61 of file concat.hh.

---

Member Typedef Documentation

typedef char lestes::lang::cplus::lex::concat::char_type

Type of character in flex.

Definition at line 64 of file concat.hh.

typedef int lestes::lang::cplus::lex::concat::size_type

Type of size in flex.

Definition at line 66 of file concat.hh.

typedef struct concat_guts::yy_buffer_state* lestes::lang::cplus::lex::concat::yy_buffer_type [read, private]

Type of flex buffer.

Definition at line 82 of file concat.hh.

---

Constructor & Destructor Documentation

lestes::lang::cplus::lex::concat::~concat

(

void

)

[virtual]

Finalizes object.

Finalizes the object, releases flex buffer.

Definition at line 67 of file concat.cc.

References yy_buffer, and yy_delete_buffer().

{
        concat_guts::yy_delete_buffer(yy_buffer);
}

lestes::lang::cplus::lex::concat::concat

(

void

)

[protected]

Creates the object.

Creates the object, allocates flex buffer.

Definition at line 58 of file concat.cc.

References yy_buffer, and yy_switch_to_buffer().

Referenced by instance().

                  :
        yy_buffer(concat_guts::yy_new_buffer(NULL,YY_BUF_SIZE))
{
        concat_guts::yy_switch_to_buffer(yy_buffer);
}

lestes::lang::cplus::lex::concat::concat

(

const concat &

copy

)

[private]

Hides copy constructor.

---

Member Function Documentation

concat::size_type lestes::lang::cplus::lex::concat::yy_input	(	char_type *	cbuf,
		size_type	max
	)

Stores next characters for YY_INPUT.

Fills buffer with characters from current input string. Called through YY_INPUT flex macro.

Parameters:

	cbuf	The buffer to fill.
	max	Maximum count of characters to fill.

Returns:

The actual count of filled characters.

Definition at line 125 of file concat.cc.

References index, length, lestes::lang::cplus::lex::ucn_token::TOK_EOF, lestes::lang::cplus::lex::ucn_token::TOK_TRANSLATED, u, value, and YY_NULL.

{
        size_type cnt;
        
        if (index == length) return YY_NULL;

        // put all tokens up to max into buffer
        for (cnt = 0; cnt < max; cnt++) {
                if (index == length) {
                        *cbuf++ = static_cast<char_type>(ucn_token::TOK_EOF);
                        cnt++;
                        break;
                }
                ucn u = value[index++];
                if (character::is_basic(u)) {
                        *cbuf++ = static_cast<char_type>(character::extract_value(u));
                } else {
                        *cbuf++ = static_cast<char_type>(ucn_token::TOK_TRANSLATED);
                }
        }

        return cnt;
}

ptr< token_sequence > lestes::lang::cplus::lex::concat::process	(	const ptr< pp_token > &	left,
		const ptr< pp_token > &	right
	)

Performs token concatenation.

Atttempts to concatenate two tokens.

Precondition:

left != NULL || right != NULL.

Parameters:

	left	The left token to concatenate.
	right	The right token to concatenate.

Returns:

A token sequence containing the new token, or the input tokens in case of error.

Definition at line 79 of file concat.cc.

References concat_parse(), lestes::lang::cplus::lex::token_value::create(), lestes::lang::cplus::lex::token_sequence::create(), index, lassert, length, lestes::report, lestes::lang::cplus::lex::unable_to_concatenate, value, and yyrestart().

{
        lassert(left || right);

        ptr<token_sequence> result = token_sequence::create();
        ptr<source_location> loc;

        value = "";

        if (left) {
                loc = left->location_get();
                value += left->spelling_get();
        } else {
                loc = right->location_get();
        }

        if (right) {
                value += right->spelling_get();
        }
  
        length = value.length();
        index = 0;

        // pretend having a new file
        concat_guts::yyrestart(NULL);
        ptr<pp_token> tok = concat_guts::concat_parse(loc,token_value::create(value));
        
        if (!tok) {
                // concatenation failed
                report << unable_to_concatenate << loc;
                if (left) result->add_back(left);
                if (right) result->add_back(right);
        } else {
                // successful attempt
                result->add_back(tok);
        }
        return result;
}

ptr< concat > lestes::lang::cplus::lex::concat::instance

(

void

)

[static]

Returns the only instance.

Returns the only instance of the object.

Returns:

The new instance with own flexer buffer.

Definition at line 161 of file concat.cc.

References concat(), and singleton.

Referenced by lestes::lang::cplus::lex::macro_body::expand().

{
        if (!singleton) {
                singleton =  new concat();
        }
        return singleton;
}

void lestes::lang::cplus::lex::concat::gc_mark

(

void

)

[protected, virtual]

Marks the object.

Marks the object.

Reimplemented from lestes::std::mem::keystone.

Definition at line 152 of file concat.cc.

References lestes::std::mem::keystone::gc_mark().

{
	::lestes::std::object::gc_mark();
}

concat& lestes::lang::cplus::lex::concat::operator=

(

const concat &

rhs

)

[private]

Hides assignment operator.

---

Member Data Documentation

yy_buffer_type lestes::lang::cplus::lex::concat::yy_buffer [private]

Flex buffer.

Definition at line 84 of file concat.hh.

Referenced by concat(), and ~concat().

ucn_string lestes::lang::cplus::lex::concat::value [private]

Current value of input string.

Definition at line 86 of file concat.hh.

Referenced by process(), and yy_input().

ucn_string::size_type lestes::lang::cplus::lex::concat::index [private]

Current index in the input.

Definition at line 88 of file concat.hh.

Referenced by process(), and yy_input().

ucn_string::size_type lestes::lang::cplus::lex::concat::length [private]

Current length of the input.

Definition at line 90 of file concat.hh.

Referenced by process(), and yy_input().

ptr< concat > lestes::lang::cplus::lex::concat::singleton [static, private]

The only instance.

The only instance of the class, managing the associated flexer.

Definition at line 96 of file concat.hh.

Referenced by instance().

---

The documentation for this class was generated from the following files:

• concat.hh
• concat.cc

---