Files
mercury/compiler/switch_gen.m
Zoltan Somogyi 189b9215ae This diff implements stack slot optimization for the LLDS back end based on
Estimated hours taken: 400
Branches: main

This diff implements stack slot optimization for the LLDS back end based on
the idea that after a unification such as A = f(B, C, D), saving the
variable A on the stack indirectly also saves the values of B, C and D.

Figuring out what subset of {B,C,D} to access via A and what subset to access
via their own stack slots is a tricky optimization problem. The algorithm we
use to solve it is described in the paper "Using the heap to eliminate stack
accesses" by Zoltan Somogyi and Peter Stuckey, available in ~zs/rep/stackslot.
That paper also describes (and has examples of) the source-to-source
transformation that implements the optimization.

The optimization needs to know what variables are flushed at call sites
and at program points that establish resume points (e.g. entries to
disjunctions and if-then-elses). We already had code to compute this
information in live_vars.m, but this code was being invoked too late.
This diff modifies live_vars.m to allow it to be invoked both by the stack
slot optimization transformation and by the code generator, and allows its
function to be tailored to the requirements of each invocation.

The information computed by live_vars.m is specific to the LLDS back end,
since the MLDS back ends do not (yet) have the same control over stack
frame layout. We therefore store this information in a new back end specific
field in goal_infos. For uniformity, we make all the other existing back end
specific fields in goal_infos, as well as the similarly back end specific
store map field of goal_exprs, subfields of this new field. This happens
to significantly reduce the sizes of goal_infos.

To allow a more meaningful comparison of the gains produced by the new
optimization, do not save any variables across erroneous calls even if
the new optimization is not enabled.

compiler/stack_opt.m:
	New module containing the code that performs the transformation
	to optimize stack slot usage.

compiler/matching.m:
	New module containing an algorithm for maximal matching in bipartite
	graphs, specialized for the graphs needed by stack_opt.m.

compiler/mercury_compile.m:
	Invoke the new optimization if the options ask for it.

compiler/stack_alloc.m:
	New module containing code that is shared between the old,
	non-optimizing stack slot allocation system and the new, optimizing
	stack slot allocation system, and the code for actually allocating
	stack slots in the absence of optimization.

	Live_vars.m used to have two tasks: find out what variables need to be
	saved on the stack, and allocating those variables to stack slots.
	Live_vars.m now does only the first task; stack_alloc.m now does
	the second, using code that used to be in live_vars.m.

compiler/trace_params:
	Add a new function to test the trace level, which returns yes if we
	want to preserve the values of the input headvars.

compiler/notes/compiler_design.html:
	Document the new modules (as well as trace_params.m, which wasn't
	documented earlier).

compiler/live_vars.m:
	Delete the code that is now in stack_alloc.m and graph_colour.m.

	Separate out the kinds of stack uses due to nondeterminism: the stack
	slots used by nondet calls, and the stack slots used by resumption
	points, in order to allow the reuse of stack slots used by resumption
	points after execution has left their scope. This should allow the
	same stack slots to be used by different variables in the resumption
	point at the start of an else branch and nondet calls in the then
	branch, since the resumption point of the else branch is not in effect
	when the then branch is executed.

	If the new option --opt-no-return-calls is set, then say that we do not
	need to save any values across erroneous calls.

	Use type classes to allow the information generated by this module
	to be recorded in the way required by its invoker.

	Package up the data structures being passed around readonly into a
	single tuple.

compiler/store_alloc.m:
	Allow this module to be invoked by stack_opt.m without invoking the
	follow_vars transformation, since applying follow_vars before the form
	of the HLDS code is otherwise final can be a pessimization.

	Make the module_info a part of the record containing the readonly data
	passed around during the traversal.

compiler/common.m:
	Do not delete or move around unifications created by stack_opt.m.

compiler/call_gen.m:
compiler/code_info.m:
compiler/continuation_info.m:
compiler/var_locn.m:
	Allow the code generator to delete its last record of the location
	of a value when generating code to make an erroneous call, if the new
	--opt-no-return-calls option is set.

compiler/code_gen.m:
	Use a more useful algorithm to create the messages/comments that
	we put into incr_sp instructions, e.g. by distinguishing between
	predicates and functions. This is to allow the new scripts in the
	tool directory to gather statistics about the effect of the
	optimization on stack frame sizes.

library/exception.m:
	Make a hand-written incr_sp follow the new pattern.

compiler/arg_info.m:
	Add predicates to figure out the set of input, output and unused
	arguments of a procedure in several different circumstances.
	Previously, variants of these predicates were repeated in several
	places.

compiler/goal_util.m:
	Export some previously private utility predicates.

compiler/handle_options.m:
	Turn off stack slot optimizations when debugging, unless
	--trace-optimized is set.

	Add a new dump format useful for debugging --optimize-saved-vars.

compiler/hlds_llds.m:
	New module for handling all the stuff specific to the LLDS back end
	in HLDS goal_infos.

compiler/hlds_goal.m:
	Move all the relevant stuff into the new back end specific field
	in goal_infos.

compiler/notes/allocation.html:
	Update the documentation of store maps to reflect their movement
	into a subfield of goal_infos.

compiler/*.m:
	Minor changes to accomodate the placement of all back end specific
	information about goals from goal_exprs and individual fields of
	goal_infos into a new field in goal_infos that gathers together
	all back end specific information.

compiler/use_local_vars.m:
	Look for sequences in which several instructions use a fake register
	or stack slot as a base register pointing to a cell, and make those
	instructions use a local variable instead.

	Without this, a key assumption of the stack slot optimization,
	that accessing a field in a cell costs only one load or store
	instruction, would be much less likely to be true. (With this
	optimization, the assumption will be false only if the C compiler's
	code generator runs out of registers in a basic block, which for
	the code we generate should be unlikely even on x86s.)

compiler/options.m:
	Make the old option --optimize-saved-vars ask for both the old stack
	slot optimization (implemented by saved_vars.m) that only eliminates
	the storing of constants in stack slots, and the new optimization.

	Add two new options --optimize-saved-vars-{const,cell} to turn on
	the two optimizations separately.

	Add a bunch of options to specify the parameters of the new
	optimizations, both in stack_opt.m and use_local_vars.m. These are
	for implementors only; they are deliberately not documented.

	Add a new option, --opt-no-return-cells, that governs whether we avoid
	saving variables on the stack at calls that cannot return, either by
	succeeding or by failing. This is for implementors only, and thus
	deliberately documented only in comments. It is enabled by default.

compiler/optimize.m:
	Transmit the value of a new option to use_local_vars.m.

doc/user_guide.texi:
	Update the documentation of --optimize-saved-vars.

library/tree234.m:
	Undo a previous change of mine that effectively applied this
	optimization by hand. That change complicated the code, and now
	the compiler can do the optimization automatically.

tools/extract_incr_sp:
	A new script for extracting stack frame sizes and messages from
	stack increment operations in the C code for LLDS grades.

tools/frame_sizes:
	A new script that uses extract_incr_sp to extract information about
	stack frame sizes from the C files saved from a stage 2 directory
	by makebatch and summarizes the resulting information.

tools/avg_frame_size:
	A new script that computes average stack frame sizes from the files
	created by frame_sizes.

tools/compare_frame_sizes:
	A new script that compares the stack frame size information
	extracted from two different stage 2 directories by frame_sizes,
	reporting on both average stack frame sizes and on specific procedures
	that have different stack frame sizes in the two versions.
2002-03-28 03:44:41 +00:00

337 lines
12 KiB
Mathematica

%-----------------------------------------------------------------------------%
% Copyright (C) 1994-2002 The University of Melbourne.
% This file may only be copied under the terms of the GNU General
% Public License - see the file COPYING in the Mercury distribution.
%---------------------------------------------------------------------------%
%
% File: switch_gen.m
% Authors: conway, fjh, zs
%
% This module handles the generation of code for switches, which are
% disjunctions that do not require backtracking. Switches are detected
% in switch_detection.m. This is the module that determines what
% sort of indexing to use for each switch and then actually generates the
% code.
%
% Currently the following forms of indexing are used:
%
% For switches on atomic data types (int, char, enums),
% if the cases are not sparse, we use the value of the switch variable
% to index into a jump table.
%
% If all the alternative goals for a switch on an atomic data type
% contain only construction unifications of constants, then we generate
% a dense lookup table (an array) for each output variable of the switch,
% rather than a dense jump table, so that executing the switch becomes
% a matter of doing an array index for each output variable - avoiding
% the branch overhead of the jump-table.
%
% For switches on discriminated union types, we generate code that does
% indexing first on the primary tag, and then on the secondary tag (if
% the primary tag is shared between several function symbols). The
% indexing code for switches on both primary and secondary tags can be
% in the form of a try-me-else chain, a try chain, a dense jump table
% or a binary search.
%
% For switches on strings, we lookup the address to jump to in a
% hash table, using open addressing to resolve hash collisions.
%
% For all other cases (or if the --smart-indexing option was
% disabled), we just generate a chain of if-then-elses.
%
%---------------------------------------------------------------------------%
:- module ll_backend__switch_gen.
:- interface.
:- import_module parse_tree__prog_data, hlds__hlds_goal, hlds__hlds_data.
:- import_module backend_libs__code_model, ll_backend__code_info.
:- import_module ll_backend__llds.
:- import_module list.
:- pred switch_gen__generate_switch(code_model, prog_var, can_fail, list(case),
hlds_goal_info, code_tree, code_info, code_info).
:- mode switch_gen__generate_switch(in, in, in, in, in, out, in, out)
is det.
%---------------------------------------------------------------------------%
:- implementation.
:- import_module hlds__hlds_llds.
:- import_module check_hlds__type_util.
:- import_module ll_backend__dense_switch, ll_backend__string_switch.
:- import_module ll_backend__tag_switch, ll_backend__lookup_switch.
:- import_module ll_backend__code_gen, ll_backend__unify_gen.
:- import_module ll_backend__code_aux, ll_backend__code_util.
:- import_module ll_backend__trace.
:- import_module backend_libs__switch_util.
:- import_module libs__globals, libs__options, libs__tree.
:- import_module bool, int, string, map, std_util, require.
%---------------------------------------------------------------------------%
% Choose which method to use to generate the switch.
% CanFail says whether the switch covers all cases.
switch_gen__generate_switch(CodeModel, CaseVar, CanFail, Cases, GoalInfo,
Code) -->
{ goal_info_get_store_map(GoalInfo, StoreMap) },
switch_gen__determine_category(CaseVar, SwitchCategory),
code_info__get_next_label(EndLabel),
switch_gen__lookup_tags(Cases, CaseVar, TaggedCases0),
{ list__sort_and_remove_dups(TaggedCases0, TaggedCases) },
code_info__get_globals(Globals),
{ globals__lookup_bool_option(Globals, smart_indexing,
Indexing) },
(
% Check for a switch on a type whose representation
% uses reserved addresses
{ list__member(Case, TaggedCases) },
{ Case = case(_Priority, Tag, _ConsId, _Goal) },
{
Tag = reserved_address(_)
;
Tag = shared_with_reserved_addresses(_, _)
}
->
% XXX This may be be inefficient in some cases.
switch_gen__generate_all_cases(TaggedCases, CaseVar,
CodeModel, CanFail, StoreMap, EndLabel, no, MaybeEnd,
Code)
;
{ Indexing = yes },
{ SwitchCategory = atomic_switch },
code_info__get_maybe_trace_info(MaybeTraceInfo),
{ MaybeTraceInfo = no },
{ list__length(TaggedCases, NumCases) },
{ globals__lookup_int_option(Globals, lookup_switch_size,
LookupSize) },
{ NumCases >= LookupSize },
{ globals__lookup_int_option(Globals, lookup_switch_req_density,
ReqDensity) },
lookup_switch__is_lookup_switch(CaseVar, TaggedCases, GoalInfo,
CanFail, ReqDensity, StoreMap, no, MaybeEndPrime,
CodeModel, FirstVal, LastVal, NeedRangeCheck,
NeedBitVecCheck, OutVars, CaseVals, MLiveness)
->
{ MaybeEnd = MaybeEndPrime },
lookup_switch__generate(CaseVar, OutVars, CaseVals,
FirstVal, LastVal, NeedRangeCheck, NeedBitVecCheck,
MLiveness, StoreMap, no, Code)
;
{ Indexing = yes },
{ SwitchCategory = atomic_switch },
{ list__length(TaggedCases, NumCases) },
{ globals__lookup_int_option(Globals, dense_switch_size,
DenseSize) },
{ NumCases >= DenseSize },
{ globals__lookup_int_option(Globals, dense_switch_req_density,
ReqDensity) },
dense_switch__is_dense_switch(CaseVar, TaggedCases, CanFail,
ReqDensity, FirstVal, LastVal, CanFail1)
->
dense_switch__generate(TaggedCases,
FirstVal, LastVal, CaseVar, CodeModel, CanFail1,
StoreMap, EndLabel, no, MaybeEnd, Code)
;
{ Indexing = yes },
{ SwitchCategory = string_switch },
{ list__length(TaggedCases, NumCases) },
{ globals__lookup_int_option(Globals, string_switch_size,
StringSize) },
{ NumCases >= StringSize }
->
string_switch__generate(TaggedCases, CaseVar, CodeModel,
CanFail, StoreMap, EndLabel, no, MaybeEnd, Code)
;
{ Indexing = yes },
{ SwitchCategory = tag_switch },
{ list__length(TaggedCases, NumCases) },
{ globals__lookup_int_option(Globals, tag_switch_size,
TagSize) },
{ NumCases >= TagSize }
->
tag_switch__generate(TaggedCases, CaseVar, CodeModel, CanFail,
StoreMap, EndLabel, no, MaybeEnd, Code)
;
% To generate a switch, first we flush the
% variable on whose tag we are going to switch, then we
% generate the cases for the switch.
switch_gen__generate_all_cases(TaggedCases, CaseVar,
CodeModel, CanFail, StoreMap, EndLabel, no, MaybeEnd,
Code)
),
code_info__after_all_branches(StoreMap, MaybeEnd).
%---------------------------------------------------------------------------%
% We categorize switches according to whether the value
% being switched on is an atomic type, a string, or
% something more complicated.
:- pred switch_gen__determine_category(prog_var, switch_category,
code_info, code_info).
:- mode switch_gen__determine_category(in, out, in, out) is det.
switch_gen__determine_category(CaseVar, SwitchCategory) -->
code_info__variable_type(CaseVar, Type),
code_info__get_module_info(ModuleInfo),
{ classify_type(Type, ModuleInfo, TypeCategory) },
{ switch_util__type_cat_to_switch_cat(TypeCategory, SwitchCategory) }.
%---------------------------------------------------------------------------%
:- pred switch_gen__lookup_tags(list(case), prog_var, cases_list,
code_info, code_info).
:- mode switch_gen__lookup_tags(in, in, out, in, out) is det.
switch_gen__lookup_tags([], _, []) --> [].
switch_gen__lookup_tags([Case | Cases], Var, [TaggedCase | TaggedCases]) -->
{ Case = case(ConsId, Goal) },
code_info__cons_id_to_tag(Var, ConsId, Tag),
{ switch_util__switch_priority(Tag, Priority) },
{ TaggedCase = case(Priority, Tag, ConsId, Goal) },
switch_gen__lookup_tags(Cases, Var, TaggedCases).
%---------------------------------------------------------------------------%
%---------------------------------------------------------------------------%
% Generate a switch as a chain of if-then-elses.
%
% To generate a case for a switch we generate
% code to do a tag-test and fall through to the next case in
% the event of failure.
%
% Each case except the last consists of
%
% a tag test, jumping to the next case if it fails
% the goal for that case
% code to move variables to where the store map says they
% ought to be
% a branch to the end of the switch.
%
% For the last case, if the switch covers all cases that can occur,
% we don't need to generate the tag test, and we never need to
% generate the branch to the end of the switch.
%
% After the last case, we put the end-of-switch label which other
% cases branch to after their case goals.
%
% In the important special case of a det switch with two cases,
% we try to find out which case will be executed more frequently,
% and put that one first. This minimizes the number of pipeline
% breaks caused by taken branches.
:- pred switch_gen__generate_all_cases(list(extended_case), prog_var,
code_model, can_fail, store_map, label, branch_end, branch_end,
code_tree, code_info, code_info).
:- mode switch_gen__generate_all_cases(in, in, in, in, in, in, in, out, out,
in, out) is det.
switch_gen__generate_all_cases(Cases0, Var, CodeModel, CanFail, StoreMap,
EndLabel, MaybeEnd0, MaybeEnd, Code) -->
code_info__produce_variable(Var, VarCode, _Rval),
(
{ CodeModel = model_det },
{ CanFail = cannot_fail },
{ Cases0 = [Case1, Case2] },
{ Case1 = case(_, _, _, Goal1) },
{ Case2 = case(_, _, _, Goal2) }
->
code_info__get_pred_id(PredId),
code_info__get_proc_id(ProcId),
{ code_util__count_recursive_calls(Goal1, PredId, ProcId,
Min1, Max1) },
{ code_util__count_recursive_calls(Goal2, PredId, ProcId,
Min2, Max2) },
{
Max1 = 0, % Goal1 is a base case
Min2 = 1 % Goal2 is probably singly recursive
->
Cases = [Case2, Case1]
;
Max2 = 0, % Goal2 is a base case
Min1 > 1 % Goal1 is at least doubly recursive
->
Cases = [Case2, Case1]
;
Cases = Cases0
}
;
{ Cases = Cases0 }
),
switch_gen__generate_cases(Cases, Var, CodeModel, CanFail,
StoreMap, EndLabel, MaybeEnd0, MaybeEnd, CasesCode),
{ Code = tree(VarCode, CasesCode) }.
:- pred switch_gen__generate_cases(list(extended_case), prog_var, code_model,
can_fail, store_map, label, branch_end, branch_end, code_tree,
code_info, code_info).
:- mode switch_gen__generate_cases(in, in, in, in, in, in, in, out, out,
in, out) is det.
% At the end of a locally semidet switch, we fail because we
% came across a tag which was not covered by one of the cases.
% It is followed by the end of switch label to which the cases
% branch.
switch_gen__generate_cases([], _Var, _CodeModel, CanFail, _StoreMap,
EndLabel, MaybeEnd, MaybeEnd, Code) -->
( { CanFail = can_fail } ->
code_info__generate_failure(FailCode)
;
{ FailCode = empty }
),
{ EndCode = node([
label(EndLabel) -
"end of switch"
]) },
{ Code = tree(FailCode, EndCode) }.
switch_gen__generate_cases([case(_, _, Cons, Goal) | Cases], Var, CodeModel,
CanFail, StoreMap, EndLabel, MaybeEnd0, MaybeEnd, CasesCode) -->
code_info__remember_position(BranchStart),
(
{ Cases = [_|_] ; CanFail = can_fail }
->
unify_gen__generate_tag_test(Var, Cons, branch_on_failure,
NextLabel, TestCode),
trace__maybe_generate_internal_event_code(Goal, TraceCode),
code_gen__generate_goal(CodeModel, Goal, GoalCode),
code_info__generate_branch_end(StoreMap, MaybeEnd0, MaybeEnd1,
SaveCode),
{ ElseCode = node([
goto(label(EndLabel)) -
"skip to the end of the switch",
label(NextLabel) -
"next case"
]) },
{ ThisCaseCode =
tree(TestCode,
tree(TraceCode,
tree(GoalCode,
tree(SaveCode,
ElseCode))))
}
;
trace__maybe_generate_internal_event_code(Goal, TraceCode),
code_gen__generate_goal(CodeModel, Goal, GoalCode),
code_info__generate_branch_end(StoreMap, MaybeEnd0, MaybeEnd1,
SaveCode),
{ ThisCaseCode =
tree(TraceCode,
tree(GoalCode,
SaveCode))
}
),
code_info__reset_to_position(BranchStart),
% generate the rest of the cases.
switch_gen__generate_cases(Cases, Var, CodeModel, CanFail, StoreMap,
EndLabel, MaybeEnd1, MaybeEnd, OtherCasesCode),
{ CasesCode = tree(ThisCaseCode, OtherCasesCode) }.
%------------------------------------------------------------------------------%